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Karl-Heinz Eger 


Sequential Tests 


The present text Pı- --.> a systematic introduction to sequential 
tests. By means of a new conjugacy principle the properties of 
sequential likelihood ratio tests are investigated. Broad space is 
devoted to Wald's likelihood ratio test where constructive aspects 


Tacteristics play an important part. A direct method of the compu- 
tation of the characteristics of Wald's sequential likelihood 


size may be reduced to that of solving systems of linear equations. 
Moreover, a continuous inspection scheme based on sequential tests 
and the discrimination among more than two hypotheses are con- 
Sidered. A test for a Simultaneous observation of several Bernoulli 
distributed random variables is discussed, a ER 


ung in die Theo- 
Konjugiertheits- 
Quotienten- 
quentiéllen 


- ‘ext ist eine systematische Einführ 
Der Ve Ten Tests, Mit Hilfe eines neuen 
rie der erden die Eigenschaften des sequentiellen 
DE sucht. Breiter Raum wird dem Waldschen se 
tests eea test eingeräumt, wobei konstruktive Gesichtspunkte wie 
ae el zulässiger Tests oder die Berechnung der Charak- 
die tiken sequentieller Tests im Vordergrund Stehen. Es wird eine 
lirekte Methode zur Berechnung der Charakteristiken des Waldschen | 
en Quotiententests entwickelt, mit der die Berechnung | 
SCENE Charakteristiken, wie der Machtfunktion oder der Momente | 
des Stichprobenumfangs, auf die Lösung linearer Gleichungssysteme 
zurückgeführt werden kann. Darüber hinaus wird ein köntinuierli- 
ches Stichprobenverfahren auf der Basis sequentieller Tests und 
die Unterscheidung zwischen mehr - als zwei Hypothesen mit Hilfe 
sequentieller Tests betrachtet. Außerdem wird ein Test für die 
gleichzeitige Beobachtung mehrerer O-1-verteilter Zufallsgrößen 


vorgestellt. 


Le texte présent est un introduction systématique dans la théorie 
des tests séquentiels. i l'aide d'un nouveau principe de conju- 
Li sequentiel. On donne 


aison on étude les propriétés du ratio-test Ll 
ane attention particulière au ratio-test s@quentiel de Wald, en 


considérant en premier lieu des aspects constructifs, comme la 
construction de tests admissibles ou la computation des caracté- 
ristiques de tests séquentiels. On développe une méthode directe 
pour la computation des caractéristiques du ratio-test sequentiel 
de Wald qui permet de ramener la computation de telles caract&- 
ristiques, comme de la fonction puissance ou des moments de la 
taille d'échantillons, au cas de la résolution de Systémes liné- 
aires d'equations. De plus, on considère une méthode d'&chantillons 
continue sur la base de tests s&quentiels et la distinction entre 
plus de 2 hypothéses a l'aide tests sequentiels. En outre, on 
observation de plusieurs variables 


présente un test pour 1' 
aléatoires avec une distribution a deux points en même temps. 


Hacrorwan pa6oTa npegctasnret co6oÜ CHCTeMaTHYeCKOe BBeAdeHHe B 


TEOPHH NOCNEAOBATeNbHHX KPHTEPHEB. 
"Ion nomoųn Hosoro Dpuuuuns CONPRHEHHOCTH HCCNeAyWTCA CBOÄCTBa no- 
CNENOBATENLHOFO KPHTePHA mpasaononoöHR. Bonbwoe BHHMaHHe yAenAeTCA 


NOCHE ROBATENBHOMY KPHTEPUM MpasgononoGur Dan ne, npuuem 8 UEHTPE 
BHAMAHHA CTORT KOHCTPIYIKTHBHLIA ACNEKTH, Don, HANPHMep, KOHCTPYKUHR 
HOMYCTHMEIX KPHUTEPHEB nnn BHYHCNeHHe xXaAPAKTEPHCTHK nocnegosaTenb- 


HBIX HPHTEPHEB. 
Paspa6oTaetcr npamoi METOA BEINHTNEHHR XapaKTepHCTHK nocnenopatens- 
HOFO KPHTEPHR NpaBgonogO6uA Donna, NO3BONAWUHĂ ceecty BEIYHHCMEHHE 


TAHNHX X@paHTepHCTHK, 
Dopnn, K Deuenug CHETEM DHHEH HHN 


PA3nH4eHHe Memay Öonee 42M 2 vunoreaauu c NOMOWbO MOCNEAOBATENLHHX 
KPHTepHeB. Hpome TOrO, MpeacTasnrertca KHPHTEPHH ana OAHOBPEMBHHOFD 


Prefacea 


” The purpose of this text is to provide readers w 


troduction to sequential tests, 
Wald's monograph ‘Sequential Ana 


ith a systematic in- 
Since the publication of Abraham 

in the late forties theoreti- 
c has grown rapidly. The in- 


tests and the effective com- 


This is a Significant aspect in 
» and application of sequential 


putation of their characteristics. 
respect of the design 
tests, 


» assessment 


Full exploitation of the advantages of se 
corresponding theoretical foundation. 
effective design of sequential tests i 


Quential tests requires 3 
Without such a foundation the 
s difficult. Therefore, besides 


the explanation of the basic elements of the sequential test theory 


one aim of this text is to elaborate those elements of the theory 


which may be relevant to the design and applicatio 


n of sequential 
tests, 


Chapter 1 serves to introduce the theory of sequential tests and 
their embedding in the general theory of sequential statistics. Tho- 
se parts of the general theory are elaborated which are relevant for 
an investigation of the properties of sequential tests. In Section 
1.6 a conjugacy principle is developed which will serve as a useful 
device in investigating the quantitative and qualitative properties 
of sequential tests. The reader who is more interested in design of 
sequential tests may consider Sections 1.1 to 1.5 more from an in- 
formatory point of view, whereas the conjugacy concept of Section 1.6 
will be needed for a basic understanding of the subsequent sections. 


Chapter 2 is devoted to the systematic investigation of the proper- 
ties of sequential likelihood ratio tests in which, of course, Wald's 
likelihood ratio test plays a particular role. Besides dealing with 
the general properties of sequential likelihood ratio tests, con- 
structive aspects will play an important part, for instance, the de- 
sign of admissible tests or the approximate computation of the cha- 
racteristics of Wald's likelihood ratio test. 


Chapter 3 presents a method for the computation of characteristics 


like the power function, the moments of the sample size, erc, of 
Wald's likelihood ratio test. By this method, originally developed 
for tests based on sequences of integer-valued random variables, 

the computation of the characteristics mentioned above can be redu- 
ced to that of solving systems of linear equations. Since many con- 
tinuous test nroblems can be correspondingly discretized, this 
approach will also be of interest for continuous test problems, The 
method presented only needs vector and matrix operations and can be 
easily carried out on a computer. For this reason, the author is 
convinced that this method will be one method to be takan into con- 
sideration in the design of sequential tests in the future. Some 
new aspects of the design of sequential likelihood ratio tests are 
considered in Section 3.8. Moreover, a continuous inspection scheme 


based on sequential tests is investigated. 


Finally, Chapters 4 and 5 are devoted to special problems, the dis- 
crimination among more than two hypotheses and the simultaneous ob- 
servation of several Bernoulli distributed random variables. 


It has not been possible within the scope of this little book to in- 
clude extensive numerical examples, although the author has carried 

out detailed numerical investigations in connection with the proce- 

dures presented in this text. The author would welcome corresponden- 
ce on this. 


My interest in the present undertaking was aroused by Professor 
Heckendorff, to whom I wish to express my sincere thanks for his con- 
stant interest and encouragement. My thanks are due also to the 
TEUBNER publishing house for their excellent collaboration. 


Hints of any kind will be appreciated by the author. 


Karl-Marx-Stadt 


January 1985 K.-H. Eger 
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1. General theory 


The investigations carried out by A. WALD in the early fourties, 
concerning his famous sequential likelihood ratio test, may be 
considered as the origin of a new branch of mathematical Statistic, 
the so-called sequential statistics. The beginning of this area ën 
characterized by very special investigations in connection with 
sequential tests and certain estimation probleme, and the correg. 


ponding results concerning sequential tests are contained in 


A. WALD's celebrated monograph ‘Sequential Analysis’ [77]. In the 


meantime, this subject has grown considerabely (see e.g. [46] , [49] 1. 
Many results of this field are summarized in the monographs by 
GHOSH [35] and GOVINDARAJULU [37] . Parallel to the development of 
special sequential procedures, investigations have been carried Out, 
concerning the structure of sequentiel statistical procedures, The 
investigations carried out by BAHADUR [8] are an essential contri- 
bution in this direction where the sufficiency principle is exten- 
ded to sequential statistical structures. The theory of optimal 
stopping, which is relevant for sequential statistics, is elabora- 
ted in the books by CHOW et al. [22] and ŠIRJAJEV [73] , The book 

by HECKENDORFF [40] may be considered as a concentrated elaboration 
of the foundations of sequential statistical structures. A detailed 
explanation of the theory of sequential tests and the investigation 
into the properties of these tests is not possible any longer with- 
out reference to the general theory of sequential statistical struc- 
tures. Otherwise, the space of this booklet does not allow to go 
too far into the details of the general theory. For this reason, we 


shall frequently refer to HECKENDORFF [40] in this context. 


This first section is designed to give an introduction into the ter- 
minology of the sequential tests and their embedding into the gene- 


ral theory of sequential statistical structures. In Sections 1.1 


to 1.3 the corresponding notations of the test theory are introdu- 


ced. In Section 1.4 we shall consider some sufficiency properties 

which will play a part in $8- 
sufficiency concept for simp- 
test by corresponding data Të" 


of sequential statistical structures, 
quential tests. The importance of the 
lifying the structure of a sequential 
duction is discussed as well as the significance of sufficiency is 


emphasized in connection with the computation of the characteristics 
of a sequential test. The importantrole of the sequence of the li- 


n- 
kelihood ratios for sequential tests is elaborated, and certain CH 


1.56 
vergence properties of this sequence are investigated in Section 


In Section 1.6, a new conjugacy approach is intreduced which will 


serve as a useful tool in investigating the properties of sequential 
tests. 


The reader, who is more interested in the practical design of 
sequential tests, may consider Sections 1.1 to 1.5 more from an 


informatory point of view, whereas the results of Section 1.6 will 
fundamentally be needed in the subsequent sections. 


1.1 Introduction 


Let Q, FLP) be a statistical structure to any given experiment 
where (2, ) denotes a measurable space and P a family of possib- 
le probability measures on (<2,F ). We suppose that the experiment 
can be carried out in successive steps or stages and that a corres- 


ponding sequence déi sent of non-decreasing sub-6-algebras of 


Fis given, completed by Foo = ( U ‚En so that for every nel” 
nen 


the sub- - algebra Fa can be interpreted as the set of all events 
which are observational until the n?” stage of the experiment. If 
we denote by E, the restriction of the family © from (2,6) to 
(R.F_). we obtain a statistical structure (Rif nik a) which can 
be regarded as a statistical structure for the first n stages of 
the experiment, or in a more general sense, as a statistical struc- 


ture at the fixed sample size n, nef", 


This approach can be generalized as follows. Let N: SL>T* be a 
stopping time?) with respect to (w.r.t.) the sequence of §-algebras 
AE A , then we may write this stopping time always as 

nent 


inf An>1: Ken = T ‚if such an n exists, 


ee i otherwise . 


N = (1.1) 


Based en this stopping time N, we can obtain a random sample size 
in the following manner. Beginning with n = 1, we continue the ex- 
periment or continue sampling as long as X dnan} = O for n = 1,2,... 
We stop the experiment or sampling after n stages if we observe 


X {Nan} = 1 at the nen sampling stage for the first time. 


Each stopping time N w.r.t. {En} nen! generates a © -algebra Ee 


E -6 K Fairen) FLEF,: ner*h 


1) A measurable function N: > Mt ig called a stopping time w.r.t. 
AF nj ens if LNN) EF p ner”. 


defined by 


This is the so-called G-algebra of the N-past and it containg alı 
those events of F which can be observed, using a sample size given 
N. Thus, we obtain a corresponding statistical 


by stopping time 
an d (QF ye Pryde where (e? denotes the restriction of 


the family E from (2,F) to (H Fy)’ Such a structure is Calley 
For further statistical details 


a sequential statistical structure. 
of such structures, we refer to HECKENDORFF [40] e 
For the following investigations, it will be convenient to SUppose 


that family Y is indexed by a parameter 8 that belongs to a para- 
22. 

meter set ©) , so that Fes 4 Po: OC Ol and card GA 2. The sta. 

tistical procedures under consideration are then defined as follows, 


Definition 1.1.1. Let Fa] er be a non-decreasing 


sequence of sub-6 -algebras of F and N a stopping time w.r.t, 
f let E be the corresponding G-algebra of the N-past, 


and let 6: Q- [0,1] be an ( F yX% t) -measurable function. Then, to 
any given non-empty disjoint parameter sets © -O and ©,<® ; 
the peir (N,0) is said to be a test with the sample size N and the 
terminal decision rule d for the (null) hypothesis H. GES ©, 
against the (alternative) hypothesis H,: © EO, if we proceed as 


follows: 
(i) We continue sampling as long as X Anen? = O holds for n 


and stop sampling at the first stage n, n = 1,2,..., where we ob- 


= 1,2405, 


serve X Nzn} = 1. 
(ii) If we stop sampling at stage N(w) = n, nEC+*, we reject the 


hypothesis H. (accept H,) with the probability dlw), or accept 
the hypothesis H,. respectively, if H is not rejected by it. 


o 
Briefly we shall say (N,d ) is a test based on dai PR 
net 


For a more detailed characterization of the properties of sample 
size N of any given test (N,d) we introduce the following notations. 
A test (N, ) is said to be a fixed-sample test, based on n obser- 
vations, if an n€{"* exists, so that N(w) = n for every wel. 
Each other test is called a sequential test. A test (N,d ) is said 
to be closed iff for every Oe © 


PSIN<S eo) a1. (1.2) 


(N, Ô) is said to be open iff a CEA exists with Py(N< oO )<1. 


If a test (N,d) is closed it is also usual to say the termination 


property holds or N is closed. A test (N,d) is said to be trun- 


cated at stage n, ner’, iff n is the smallest integer so that 


for every nèn and ge Gu Polen = 1 holds. 

with respect to the terminal decision rule, a test (N, d) is said 
to be randomized if an wES2 exists, where o<d(w)< 1, otherwise 
d is said to be non-randomized. We refer to HECKENDORFF [40] , 1.6, 
for a more detailed description of randomized terminal decision 
rules. The hypothesis H. Q EO, is said to be a simple hypothesis 
if ©, contains only a single parameter, otherwise Ho is said to 
be a composite hypothesis. In an analogous manner we distinguish 
between a simple and a composite alternative hypothesis H,: gel, 


According to the definition of the test (N,d), its properties are 
completely determined by the sample size N and the terminal de- 
cision rule d. Let now w:R-—> R! be any given measurable function, 
then w(N,d) is an (E 8") -measurable function. If the expectation 
value Egw(N,d ) exists for every © cO, this expectation value as 

a function of @ reflects, depending on the choice of this function 
w, certain statistical properties of the test (N,d). Therefore, 


we define the following. 


Definition 1.1.2. Let (N, È) be any given test, and let 
w: (DR! be an (E ve WË )-measurable function where Ew exists for 
every 9 EM. Then the expectation value Eon as a function of 

oe ta is called a characteristic of the test (N,0). 


We remark that a function w:{2>R! is (F ..X37)-measurable iff a 
sequence {nt =. of (F „X£ )-measurable functions wai i> Rt 
nen 


exists so that 


ZER 


w, X N =n 
nen’ d y 


holds (see [40] , Theorem 1.5). That means that we have also 


E gw = ) Sn an,” í oE Gu j 
ne j {Nan} 


where po” denotes the restriction of P, from (L.E) to (QF n). 
nel’. 


One of the most important characteristics for asses 


sing the proper- 


ties of a test is the power function or its counterpart, the ope- 


rating characteristic function. 


Definition 1.1.3. Let (N, 60) be any given test. Then the 


functions 


M(@) = Eg d XK < oo} , oc O 


and 


Q(@) = Egli - 3) Kun ech ' EG 


are called power function and operating characteristic function 
(OC-function) of (N, ), respectively. 


According to this definition, the power function provides for every 
o E GY the probability of acceptance of hypothesis H. by the test 
IN, OO at a finite sampling stage. Evidently, we have 


M(8) + (8) € 1,e0€@, 


and (N,d) is closed iff M(8) + Q(8) = 1 for every KAG) e 


If (N,d) is a sequential test, the moments EQN’, SG tep”, 
of the sample size N are important characteristics describing 
certain properties of the sample size. In this context it is usual 
to denote the first moment EQN as a function of O as the average 


sample number function (ASN-function). 


If (N,d) is a test according to Definition 1.1.1, then sample 

size N is a so-called non-randomized sample size. Of course, it 

would be possible to admit also randomized sample sizes. One way 

to obtain such a sample size ist the following. As stated above, a 

sample size N wert. ARA ent can be represented in the form (1.1). 
n 


This implies the following generalization. Let dp. S be a se- 
nen 


quence of (© .%*)-measurable functions Y #8) 9 1014), nem*, and 


let Th crt be a sequence of Bernoulli distributed random variab- 
ner 


les, where 


) i 
Po(T,=11P,.=4') = \P! and PaT lP =") =1- p 
for every 0€ © , neT* and w'e[o,1]. Then we get a randomized 
sample size N if N is defined by 
inf {n21: Th = 1} ‚if such an n exists, 
oo ‚ otherwise, 


where the decision for stopping or continuingour experiment at the 


nth sampling stage will depend on the result of an auxiliary ex- 
periment, including the observation of the random variable Ta’ The 


properties of randomized sample sizes have been investigated in 


10 


detail by BAHADUR [8] , DUHLER [26] and HECKENDORFF [40] . Due to 
the fact that no examples have been known in connection with tests 
so far, where such generalizations are of practical importance, we 
will renounce the consideration of such sample sizes here. 


1.2 Tests based on a sequence of random variables 

Frequently we have experiments where we can observe a sequence of 
random variables {x} pap) defined on (N,f), and where our de- 
cisions can only refer to these random variables. Then the sequen- 


ce {X al. „ generates a non- Kae sequence dr, nen eg of sub- 


a off with Fa e EIS, ), X = (Xp ree een), net", so that 
ae contains the whole information of our experiment which is avail- 
able , observing the vector 2 , nei", If (N,d) is a test based 


on Jr cer with Fa =§ (x, ` for nel*, we shall say (N,d) is 

a test based on (x A e For such tests the following assertion 
nen 

holds. 

Lemma 1.2.1. A test (N,d ) is based on éi vert iff a sequen- 

a E EE e 


ce of Borel sets {BY B nes", nei" ‚ exists so that 
n 


RÉI 


~ 
inf An? i: XE dd if such an n exists, 
(1,3) 
og ‚ otherwise, 


holds. 


Proof. (1) SEN vi is any given sequence of Borel sets 
elt eg", ner*, then, dene (N, di, if N is defined by (1.3), 


is a test based on {X y 
n +° 
nen 


(ii) Let (N,d ) be a test based on {X Y „. Then, for every nef, 
Bag 
we have dN net, dap E and there exists a Borel set B EL" 


with ÄN = ný = {x EB ne Sad x n€ 8, implies Xd sn} = 1. Therefore, 


we obtain 
inf {n> 1: x € dh = inf {n> 42 Xl wants A 


so that (1.3) holds, and the proof is complete. ES 


We remark that different sequences of Borel sets do not necessarily 
provide different sample sizes if the sample size is defined by 
(123). If namely {B | is any given sequence of Borel sets, 

n ner” 


BES", nef*, and if N is defined by (1.3), then we have 


11 


> En + 
(N = nJ e En È Da uf Bn] 
-p H 
s{X\en,}. ner 
Otherwise, it is always possible to reduce a given set of Borel 
9 4 H 
sets 48.) ert to a set of Borel sets (let? 80 that 


inf (nea: H di = inf {ne1: Zenit, 


and 
N=n}=<X eB}, ner’, ` 


holds. In doing this, let B/ be defined by 
n 


e Ue: x X Geh de Rt for iet, nert, 
(1.4) 


k=1 i=k+1 


then we have N = n iff X, EB, ‚nef*. Based on the sequence 


A5 '} er* defined by (1. 2), we can obtain a partition Ze nett 
of RT in disjoint sets with finite bases given by 
oo 


t 1 1 1 1 + 
ehm = Bx 4 R). R = R for ief, nef" 
i=n+1 
and 
so eo \ eo 
a, TR = Us ; 
ner* 


Such a concept has been used by ARROW, BLACKWELL, GIRSHICK [7] 


describing sample sizes for sequential procedures. 
An important special case is given by the following example. 


Example 1.2.1. The i.i.d. case. Let {x} ent be a sequence 
of independent and identically distributed (i.i.d.) random variab- 


les with values in a measurable space (% ,(X). Denote by Po i the 


corresponding distribution of Xi ‚9e@®, iem*. Then we can choose 


N, F, {F daer 7 and P = (Po. oc O} in the following manner. 
SL = Xx. x ¥, =% for ier”, 


i=1 
E, SE? A, =O for ief*, 
i=1 
fF. - QA, E: Si. A, =O for ent, 


j=n+1 x, aX for sent, 
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S Sa ei % Dr 
Pa = Po P Po = Po for Le ` 
where for every i€ IT the random variable X, can be assumed as a 
random variable X,: N—Y with 


X (w) ey for we (pre Ky pean) ELL e 


If the déin: m+ are random variables having a density f(x) w.r.t. 
(n) (n) ° 

some measure a on (% ,X), then we have Po "oe pa" ; „here 

poi”) and aM denote the restrictions of Po and pma B ma 


mM, =m for Lef", from (Q.F) to (AF n) nel’ *, Since the 

X + are assumed to be i.i.d. random variables, we obtain for 
va, (n) a (n) 

the Radon-Nikodym-derivative of Po w.r.t. M 


ap An) n 
- rw)“ 1] Rt) wa rarya ES2. 
d Lei 


It is usual to denote this derivative as the likelihood function 
at sample size n. W 


1.3 Tests based on a sequence of statistics 


However ,the structure of a test (A based on [X nef + may be 
rather complicated. This essentially depends on the geometrical 
properties of the corresponding sequence of Borel sets {Bat ne P +, 
defining sample size N. For instance, it can be very cumbersome to 
decide whether a given sampling vector X belongs to Ba or does 
not. Therefore, in view of the practical implementation of a test 
(nN, 6 ), further simplification of its structure is necessary. This 
can be done if we consider,instead of the sequence of random variab- 
les {XV ne mt, a sequence of statistics. If we have a sequence of 
vector valued statistics then we will assume that for every nel 
the dimension is equal. 

Let (L.,F ‚9 ) be a given statistical structure, let {Ff nel * be 
a sequence of non-decreasing sub-6 -algebras of F , and let 

{T Jne p+ be a sequence of statistics GË ËTT ke ['*, with 

Gn = 6 (Ta) S TE ne[’ *. Based on the sequence Toner +, we can 
obtain a sample size as follows. Let Camp m+ be any given se- 
quence of Borel sets ChE Sk ne[’*, then 
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inf {n> 1: T E De } ‚if such an n existe, 


N = 
oo ‚ otherwise 


is a sample size w.r.t. {Faine p te Let now {d tne rt be a se. 
quence of measurable functions da? R'— [0,1] ‚nel `, then d'A 
is (E.S ")-measurable. Since En -6 (T,) & En for every n ert. 


(1.5) 


the function 


d Wa tt) X {nen} (1.6) 
nef"? 


is (F y+%*)-measurable, and D ie a terminal decision rule in the 
sense of Definition 1.1.1. A test (N,6) where N and are defined 
according tof1.5) and (1.6) is called a test based on the sequence 

of statistics Anel +. We shall see that the tests considered in 
Sections 2 and 3 are just of such a simple structure. 


Beside the simplification of the structure of the sample size and 
the terminal decision rule, sequences of statistics will also play 
an important role in connection with the computation of the charac- 
teristics of any given test. In this context, the question arises 
whether sequences of statistics exist where it is sufficient to re- 
fer only to these sequences in computing the characteristics. 


To answer this question let {Taner + be any given sequence of 
statistics and {Entner + the corresponding sequence of §& -algebras 
with ch = D (Th? =F nel’*, Then the 6 -algebra Gh contains on- 
ly those events of our experiment which can be observed by means of 
an observation of the statistic T |, n el*, We note that then, in 


general, the sequence (6 hen + will not be increasing monoto- 


nously. Let ch be a 6 -algebra analogously to Fr defined by 


Gn = ohh = nyNG,: ne Da nef" i Go = [9:05 


= + 
Since & ¢ f n for ne”, we have Gn = Ee so that Gy is, in 
general, only a sub-56 -algebra of the P -algebra Ko of the N-past. 


Furthermore, one can verify that 


D, = S(N,T,) with Th > 


T. X a 
nen * n {N=n} d . 
holds (see e.g. [26] , p. 24). 


1 
Let now w: CL—> R` be an (F p: &")-measurable and P_ -integrable 


8 
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function, 0 € @) 
expectation 


Eon = Eg(Eg(w | En))- 


Since Gn = E (N, Tu). a measurable function Wo! R tia R? exists 
with 


e then we obtain by definition of the conditional 


Eg (w| En) = Mal, Tal, Po - 2.8. 


so that 


A 
Ew = Ego (NT) 


holds. This implies any characteristic Fon of a test (N,0) w.r.t. 
{Fatne ES can be represented as an expectation value of a certain 
function Wo depending, beside the parameter 9, only on N and Tye 
It is somewhat inconvenient in this representation that, as a rule, 
the function Wo depends on parameter gem, If, for instance, (N,d) 
is a test based on Klner* this dependence can be interpreted as 
follows. It compensates the arising loss of information w.r.t. para- 
meter 8 if we refer only to sequence {Taner + instead of Kninen*: 
Therefore, in connection with the computation of a characteristic 

of a test IN, d ), such sequences of statistics {Tne r*+ are of 
special interest where a version E(w] Gy) of the conditional expec- 
tation Eo(w|$,) exists which does not depend on 8 for 90€ &. 


Definition 1.3.1. The 6 -algebra En = E (N,T,) or the 
statistic DOE respectively, is said to be sufficient for Ke 
and DI ‚if for every (£ 1.8" )-measurable and P„-integrable func- 


tion w: ()— RT, a version E(w | Én) exists, which does not depend 
on 89 Ei, 


Evidently, GN is sufficient for F and © iff 


N 
Í egw [Sudro = J em Gn) dP » GE En ERO, (1.7) 


holds. We remark that this relation is satisfied if a version 


P(A | Kul of the conditional probability P,(A| En). ACS, exists 
so that 


P(A| Gy) = Pei AlB- vi, Pe = as. BE , 


holds. That means the requirement for sufficiency is ultimately a 
condition on the conditional probability Pall Gy) - An immediate 
consequence of the sufficiency is the following lemma now: 
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Lemma 1.3.1. Let (N,ó ) be a closed test based on dei 
n + 
Let w:(2—>R° be an LE wv: %1)-measurable and Po-integrable GC Mee 
oC Ga , and let {Tine rt be a sequence of statistics where & u 
1 N * 
© ty) en for F n and Gi . Then a (Gy ) -measurable 
unction w:\Z—>R” and a sequence TE, + of measurable Functions 


k 
vs R ut ner wi exists with 


ä A 
bk vk (1.8) 
and 
A > 
W = "ol Tel X nan}! Po = 3,8. r) ge 2)) D (1.9) 
ner * 


Proof: Since Sn is sufficient for a and & , a version 
Eiwl En) of the conditional expectation Eo(w| En) exists which does 
not depend on 8 for EEW . withw = E(w] En) we obtain (1.8). Now, 


was a version of Eolw| oN) is a (En: %")-measurable function, 


Then a sequence {mine ft of AT G )-measurable functions 


w:(lo RÍ, nef". exists with 


db >. WX {nen} . 


nef"? 


Since (N, §) is closed, we obtain 


w= > aX Enan} + Po as. © e®. (1.10) 


ner" 
Finally, for every nef t the 6 -algebra En is BE be Ta’ 


Then for every ne CT a measurable function Vh? ek R` exists 


This, together with (1.10), implies (1.9). W 


1.3.1. Let (N,6) be a closed test based on 


ner + be a sequence of statistics so that 


1 
fficient for F 1 and @ . Then a (Gy 8 )- 
and a sequence of measurable 


Corollar 


{F afne rt let AT, 
Gy = E (N,Tp) is su 
measurable terminal decision rule 


k + 
functions {a} ert: dE R —>{0.1] nef”, exist with 


M(9) = Eg® Eed ‚ee®, 


and A 
d = >. A daln) X {nun} * Po 7 a9. . 9€@ . (1.12) 


ne€ 


(1.11) 
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1 
p r oo f. By Lemma 1.3.1 a (Gy. )-measurable terminal decision 
rule and a corresponding sequence {4} uer + exist eo that Egó = 
e. 3 for © ei, and (1.12) holds. Since (N,4) is closed, we fur- 


ther have 


M(@) = Eg Í X 4N < oo} = Be d and Fe X (uc 20} = Eg ô e 
9 €@ . That implies (1.11). W 


The corollary shows that for a closed test in case of the sufficien- 
cy of ch we can restrict our attention to those terminal decision 
rules which depend on the set {N = nt only on T (w), nef 6 ema 
the sufficiency of Gy does not imply, in general, that also the 
sample size N can be represented only by means of the sequence 
ner * 

a further consequence of Lemma 1.3.1 in regard of a practical compu- 
tation of the characteristics of a test is the following. 


corollary 1.3.2. Suppose the assumptions of Lemma 1.3.1 


x 
are fulfilled. Then there exists a measurable function # which does 
not depend on 8 for ® EQ) , where 


Ew = Eon (N,T,,) ‚ve®. (1.13) 


=) 


Pr oo f. The function w introduced by Lemma 1.3.1 is (By BI: 
measurable. Because of Gn = 8 (N,T,) a measurable function w exists 


with 
o = w(N,Ty) N} Po - 83.5. , CG eo. 


This, together with (1.8), implies (1.13). W 


Hence, if the assumptions of Lemma 1.3.1 are fulfilled, the charac- 
teristics of any given test (n,d ) can be represented as expectation 
values of certain functions only depending on N and Tye That means 
that in case of the sufficiency of E the investigation into the 
statistical properties of a test (N,Ö ) by means of its characteri- 
stice can be reduced to the consideration of expectation values of 
functions which only depend on N and Ty 80 that methods of compu- 
ting such expectation values will play a special role. 


The computation of an expectation value Fon IN, Twl would be possible, 
for instance, by means of the common distribution function of (N,T,)). 
For some special cases we can obtain representation formulas for the 
distribution function of (N,T))« Such representation formulas have 
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2 Eger, Tests 


been investigated by DE GROOT [24] , TRYBULA [75] and FRANZ, WINK 
n explicite determination of the A 
2 


umbersome. By means Of re 
] obtained for certain i 
u 


t 
tions W * relations between os S of N and i 
eo that the computation of some characteristic Een (N,T,,) may be A 
oments of N and Ty: Specia) © 


33 8 ar W H 
[33] © WALD'S gg. 


[33] , but even in these cases a 
stribution function of (N,T,) is very © 


presentation formulas FRANZ, WINKLER [33 
Eg" (N,Ty) and the mo 


Ne. 


duced to the computation of certain m 
cases of such moment equations, considered in 


tion and the equations of HALL [39]. 
In Section 3, we shall return to the computation of the Character; 


stics of a test (N,Ö ). There a quite general method is developed, 
WALD's likelihood ratio test to 


allowing us the characteristics of 
sequence of discrete random variables with. 


be computed, based on a 
out any explicite reference to the distribution function of (NT). 


1.4 Sufficient sequences of statistics 


It follows from Section 1.3 that the sufficiency of En or (NT), 
respectively, for Fy and Di plays an essential role in regard of 
a eimplification of the structure of a test (nN, 6 ) as well as the 
computation of its characteristics. Therefore, here we consider 
some criteria for the sufficiency adapted to sequential tests, 

Let N be a sample size w.r.t. (Eet +, and let {Tne p+ be a 
sequence of statistics so that ZE 6 (Th) SE ner *, Then, by 
HECKENDORFF [40] , Theorem 1.10, the following assertion holds. If 


N is closed and ch is sufficient for F S and Di for every nef t 
then IN, Twl with 


N“ E Ta% {Nan} 
ner 
is sufficient for Fy and ® . Thus, the investigation into the 
sufficiency of (N,T,) can be reduced to the investigation into the 


sufficiency of Ti for everyne( *. In particular, the following 


lemma holds. 


Lemma 1.4.1. Let N be a closed gam 
ple size w.r.t. ri 
(Falner + 


© = H A) D 9 8 e n 
de, 9, + 4° Suppose that Pa! E del for every net: 
Denote by L any ver z 
n,8,.8, y sion of the Radon-Nikodym-derivarive of 


p_{n) (n 
, Tees Po! l DEI". Then (N,L 


1 ) with 
R05.91 
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L = L 
1 nert 
is sufficient for Fy and Gi. 


(CHECK {Nan} 


Proof. Let © be defined by elle al, nel *. De- 
u a 4 


note by Eo" ii KEE value of a certain function w w.r.t. 
n 
the measure Po e Then, for any given F€ Be and G eb, we have 


(n) 
Po, ( FA G) = Fb EAG 


Fo í Lé FAG'n,@, ,0,? 
= Fo Eo í X eng ËCH Gn)? 
= Ee (Xg L En (X ; 

o G n,8,.9, el KI 

Otherwise, we obtain 

(n) _ 
Pa, (FAG) = Eo (EQ Keng|$n)) 
S Fo, (Xo Fo, (X SKI 
z Pe (Xen 00 so: Fo, (X E| Gn): 
This implies for every FE a 


Eo (X e| Fn) = Eo (X e| Gn) ? Pe” = Bees 
and 


Po CF | Gn) = Po CF| En) ' Pe” = eG 


respectively. That means, OË? is sufficient for E, and @ = 


{0,04} for every nef’. N is closed, applying Theorem 1.10 of 
[40] , we obtain (NiLy a ,0,) is sufficient for Ev and © = {9,94}. 


It is common practice tọ denote any version of the Radon-Nikodym- 
n n 
derivative gel "uge" of Po! ) w.r.t d ) as a likelihood ratio 


at the sample size n,nef*. This notation is also mativated by 


the following example. 
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Example 1.4.1. Let {X}, em + be a sequence of i.i.d. random 


variables with a density folx). 1) Referring to Exeapre 1.2.1, we 
obtain pell «K pm“ (n) and pl DI K Te, for ne[’”. Since the 
o 1 


random variables (Xaine Dr are assumed to be independent, we ob- 


tain for the corresponding densities 


apn) n 
mje) A II folX (w)). 0E {o aj we LL. (1.14) 
M i= l 


If additionally Pol Dl P,("), nel *, holds, then Pa << AG 
1 o o 

K um) implies 
dp, (") dp”) dp DI dP (n) 


1 1 o H #(n) 
= = L , 
Garn) ar) Ain) n,9,.8, ga) ' 
(e 


This and (1.14) implies that we obtain a version ‘n 8,18, of the 


Radon-Nikodym-derivative dp Jar") if we put 
1 fe) 


n fo Xa) 
L = 
n,8,.8, ied Cé 


n 
where in case of Th, (X,(w)) = O we can choose an arbitrary 
o 


i=1 
value for RE Mäe ): B 


If now (n,d) is any given test for Ho: H = Ba against d H a 6, 
and if IN, Lo o o ) is sufficient for ei and ©, in sense of Lem- 
Toi 


ma 1.4.1, then, according to Corollary 1.3.1, we can restrict our 

attention to those terminal decision rules ó which depend on {Nan} 

only on L nef", As already stated above in connection 
KE 


with Corollary 1.3.1, the sufficiency of (N,L,, 9 oe ) does not im- 
"oi? 

ply, as a rule, that also sample size N can be represented only by 

means of the sequence Ins, ne fit. But we shall see in Section 


2 that tests whose sample size can be represented as 


We inf {nz 1: “n.8,.0 © ch » if such an n exists, 


oo » Otherwise, 
1) This terminology is used to express that ne m+ is a sequen- 
ce of i.i.d. random variables havi 
peasuire ac on (i Oxy. aving a density f(x) w.r.t some 
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where {Cy ner* denotes a 


given sequence of Borel set 1 
nef". will have quite far SE, 


-reaching optimality properties. 
The following lemma now presents a modification of NEYMAN's well- 


known factorization criterion for sufficiency adapted to sequential 
tests. 


Lemma 1.4.2. Let N be a closed sample size w.r.t. LE | rt 
let {Tai ner* be a sequence of statistics with F «6(T (ép 
ner*. If for every pair 8', o"e W, 9 + 0" and ner’ a gece 
function In 9: Or existe so that 


L p(n) - 8.8, , 


n,o',o” bel Ho go ‚onlTn) ' (1.15) 


then IN, fw with Tu = > „'n* {Nan} is sufficient for a and ©. 
ner 


Proof. For any given pair CM Mächt CN O0" and nef" let Ki be 
defined by Gn = BIL or gel: By (1.15) we obtain Ener, sf (T) 
so that L, @' o" is also (F n:% )-measurable. Then, analogously 
to the proof of Lemma 1.4.1, we can show that for every FES. 
n n n 

pC) (ELE) = PLM (FL) . PL — as., 
holds. Therefore, Kai or the statistic Le is for every net" suffi- 
cient for r and ©. N is closed, applying Theorem 1.10 of [40] , 
this completes the proof. W 


If Lemma 1.4.2 holds, then ıt is also usual to say that {Ty ert 
forms a sequence of sufficient statistics for AE Auer? and ®. 
Important examples of distribution families where sequences of 
sufficient statistics exist are the exponential families. 


Example 1.4.2. Let (Po ge) be a family of probability 
measures on (N, ), and Iert Aert be a sequence of non-decrea- 
sing sub-6 -algebras of Ç. A family of non-degenerated probability 
measures MI oe®) on (LL, Fn). net’, dominated by a 6-finite 
measure m on ($2,F,), is said to be an exponential fenily if 
real-valued functions d'Hee RT, pu? 0. and a OT SC 
(F „.%")-measurable functions hr (IR and Te : Q—>R 
j = ee P ker’ exist so that for every gef 


(n) k 

dP 

o > (J) (lait h (w) . 
—Tay w) = c (0) exp ( > dal (ëife ( n 

dus” n j= i " m(n) - A2eSe 
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n 
gi (Pg ), gett is an exponential family, then any two measures 


PL”) and p(n) 
Ch ıd Po.’ of this family are equivalent measures, and we ob. 


tain for the likelihood ratio 


k 


c (0") 
DEE RE LEE 
j= 


(n 
Ai Ze a.8. This implies, the likelihood ratio has the form (1.15) 
with T, = (Tht), 100) and for every nef" the statistic T is 

ffici d N 
sufficient for Ee and @. Hence, (N,T,) is for every closed N 
suffictent for gi and ©. An important special case is again the 
P Euns of Example 1.2.1. We suppose thaf the family SS = 
di € Ot is an exponential family. Then real-valued functions 
c:@-— sr e g ee ETA h:¥—>R? and dE j = 1,...,k, exist 
so that. density fo(x) of Pe w.r.t. ~ can be represented as 


k 
fo(x) = c(®) re It h(x) , xece% ,ee@ , 


Then we obtain for the likelihood ratio 


k n 
Le, o = (She dene EE wert, 
= i=1 


n 
Hence, T, = (TE) ,...,7(7)) with KH ECH DE TE GE 
i 


=1 
is for every ner* sufficient for a and ®) , and again by Lem- 
ma 1.4.2, IN, Twl is for every closed N sufficient for Se and © 8 


The sequence of statistics {T }ner* considered in this example pos- 
sesses for the i.i.d.-case the additional property that for every 


ner* 
re ms KH mn ty (Xanga) +o e doce k: ; 


holds. This is a special version of the so-called transitivity 
(see [40] , Section 1.5) and allows even more far-reaching data re- 
duction than sufficiency alane. Then also sample size N can be re- 
presented only by means of the sequence {T Yner* (see [40], 
Theorem 1.14). We notice, that the transitivity of the sequence 
{Ty ert will be moreover an advantageous property in connection 


with the computation of the characteristics of a test. 
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1.5 Convergence properties of the likelihood ratio sequence 


We have seen in the previous section that the sequence n,o oi nert 
of the likelihood ratios at the sample size n, nët", forms a se- 
quence of statistics allowing a simplification of the structure of a 
test (N, 5 ) for Ho: H » H. against H4: H a @ 


4 in the sense of the 
sufficiency concept. 


Obtaining additional clues to the choice of the 
sample size and the terminal decision rule of a test (NM, d ) for 
Har @ = Ba against H,: @ = ©, based on the sequence {L,,g atner* 


we consider some convergence properties of this sequence for n-> o., 


Lemma 1.5.1. Let {L 9 otnert be the sequence of the like- 
LU oi 1 


lihood ratios at sample size n, nef’, then we have 


1 

Pa (lim L = O) = 1 iff lim E L =O (1.15) 

8, n -> co VD n-> co Ba D Bach: 
and -1 

-1 

P. (lim L = 0) = 1 iff lim E L 2 =O (1.17), 

e n-> co 18,8, n- ee wl dée 
respectively. 


P reo f. First we notice that the sequence At, o otner* forms 
"o° 1 


a martingal in respect of LEE Gg and ro, This follows from 


SI = EL L a 1 for neft 
e. n,e 8, 9, n,8,:8, 
and 

dp{") 

J 1 (n) (n) 
L dP dÉ dP = PAP? (a) 
A nO, DË 8, A dal Be 8, 
O 


„ p(n+1) -z f 
Po, (A) Un+1,8 ‚8 
A o 


This martingalproperty and L 


+ 
Fe for ACF, ner 


+ 
d'M? 20 for nei" implies 


lin e 8 = L oo? O , P 


ke 4.S., 
n— co o’ 1 8, 


where L >o denotes a Pe -~ integrable random variable (see e.g. 
o 


BAUER [11] , § 60, Corollary 1). Further, because of In,0,.0, ? O 


and E 9. ~ 1 for nef" we obtain for every a> O 


8 La.8 1 


o oi 
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L 1 
1 n.H ,9 5 
= oi 1 
f L2 dP <J L 9 dP, 
A n,8 8, 8, N a De Hax 1 re) 
a > a 
d MG, 08, J Eg Log 8 
O o’ 1 4 
m nef , 
a 
so that 3 
lim sup 1 f Lag ‚oe, = 0. 


ao. n vi d O 


Hence, the sequence 4L + is uniformly integrable w,r,t. 
{ n,o 0, {ner 


P and by Theorem 1.3 of CHOW et al. [22] we obtain 


e : ; 
lim EL = EL L ; (1.18) 
n = CO Wi n,8,.8, 9, ES 
Because of L ee 2 O we obtain 
i 
EN: iff Po Iess 0) si: 
o 


o 
This, together with (1.18), provides (1.16). 


obtain (1.17). W 


In the same way we 


This lemma contains certain clues concerning the structure of a test 
(N, &) for Ho! Ə = 8, against H,: @ = 8, based on the sequence of 


likelihood ratios {the .e,sner*: If this sequence satisfies 


P. (lim L =0) = 1 
8, n—> eo NO, 84 

and 

= 0) = 1, 


-1 
Pa (lim L 
8 ËCH 


ins 


where the last condition is also equivalent to 


(lim Le zoo) = 1, 


p 
9, n -> 00 o 
then it is obvious to require that the test (N, d) possesses a 

structure which can be characterized as follows. We continue samp- 
ling for n = 1,2,... until we observe a sufficiently small or lar- 


ge value of the likelihood ratio "n,9.0,° After stopping sampling 


we accept the hypothesis Ho tf Lao 0, is small and reject Ho or 


accept H. if 1n,8.,8, is large, respectively. This is the basic 
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structure of the so-called likelihood ratio tests considered in de- 
tails in Section 2. 

The subsequent lemma now presents a further criterion for (1.16) 
and (1.17), respectively, for the 1.1.d.-case. 


Lemme 1.5.2. Let (Aler? be a sequence of 1.1.d. random va- 
riables having a density for), let {tno gaer? be the sequence 


of likelihood ratios at sample size n, nef*, Then 


1 
H 
lim En L = O Aff P (L = 1)< 1 (1,19) 
n -> co 6 dief 8, 8, 1,0, .0, 
and 4 
"3 -1 
lim En L = O iff P (L = 1) < 1 (1.20), 
neo el dd 8, H: 1,0,.9, 
respectively. 


Proof, Because the Kulner* are assumed to be i.i.d. random 
variables, we obtain 


n 
"n,8,.8, au RD ° ner’. 


This implies 


n 
2 2 
EL L = E f x,)/f X,)) 
die CHEN e [í e, i) o i 


i=1 
À 3 3 
= | IE (fo (X,)/fo (X,)) = (EOL ae 
| | Bp 94 io ts 8, 1.8.8, 
i=1 
Hence, we have 
1 1 
lim E, Bä 9 70 iff Ee Le a < Es (1.21) 
D + ec o "Toi o "Toi 


Applying Schwarz’s inequality we obtain 
1 1 1 


H H 
@,'t1,0,,0,° +) < (Fo tı,e_,e,) 1x r (1.21 ) 


where the strict equality holds iff a real number c exists with 
1 


3 
Pa IL = Cl si, 
9, 1,0594 
2 
This condition implies P (L a c?) = 1 and E, L =C. 
Otherwise, we have E L = 1. Hence we obtain c = 1. Thus, 
9, 1.0591 
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the strict inequality holds in (1.22) iff Pe E 9,91 get 


This, together with (1.21), proves (1.19). Analogously, we can estab. 
lish (1.20). W 


We remark, that the conditions 


P (L = 1) < -1 = 1)< 1 
8 )<1 and Pa (L 
1,0, 8, H. 1,0, +9 


of Lemma 1.5.2 may also be written as 
Pa (fa (lef, (X,))<1 and Pa (fa (X,)fg (%1)) <1, 
te ll alfo te, ti 


respectively, which emphasizes that these conditions (1.21) are very 
weak. We note that the considered convergence properties will also 
play a rolé in connection with the termination property of a test, 


1. 6 Conjugated parameter pairs 


Frequently, the perameter space © contains more than two parameters, 
If we consider in such a situation a test (n, 6) for a simple hypo- 
thesis Ho? O a 8, against a simple alternative hypothesis H4: 0 = di 
+9 then we are also interested in properties of this test if 
the true parameter O does not coincide with 8, or HA, In these cases, 
conjugated parameter pairs are a helpful tool. For the first time 
certain aspects of such parameter pairs were considered by GIRSHICK 
[36] in connection with the approximate computation of the operating 
characteristic function and the ASN-function of WALD's sequential 
likelihood ratio test. later on by BLASBALG [16], LECHNER [52] 

BERK [13] and SAVAGE [66] . The starting point of their conjugacy 
concept is the fact that several parameter pairs 8, and 8, and risks 
& and B can lead to the same WALD's likelihood ratio test, that 
means that they invalve in their conjugacy concept the special struc- 


ture of WALD's likelihood ratio test. 


Here we introduce a conjugacy concept allowing us to obtain relations 
between two parameter pairs of parameter space © without any refe- 
rence to the explicit structure of the underlying test, considering 
certain properties of the likelihood ratio sequence. This concept 
will be a helpful tool for the whole theory of sequential tests. 


For all further investigations we will assume that the considered 


statistical structure (SL, £,9) is characterized as follows. The 


family P of probability measures is indexed by a parameter ge 
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so that P= Ar KD . Furth 
H er, a sequence ` ` 


ven, where for every pair Or ,0" e 
en’ n ' a 
and n the corresponding restrictions p(n) and p(n) of P 


d 
„. respectively, ‘ oe 
ro e iR ` j We or (CLE ) to te ) are equivalent measures. 
en e Radon- a 
j ad ein) D Oy eee es ar?) of p(n) Wort pi) 
SÉ , ae 9" 5 A w.r.t, Po, exist for every nef’, where 
dP CTAA n) yap(m)y-1 
at / e (IP. /OP 4. ) `. We shall again denote any versions 
of these derivatives by SH and La g" gis respectively. For 
this situation we define the following. 
Definition 1.6.1. Two parameter pairs 9', g"e@), 9' + 9”, 


and TA 8, + HA, are said to be conjugated iff a real number 
h + O exists so that for every neft 


h 
Un,a' ‚or P "n,8,.8, r wefl , (1.22) 


We shall write then: (0',0")&(@ ,0,). 


We remark, that it would be possible to substitute the condition 
(1.22) in Definition 1.6.1 by the weaker condition 


A h 
Po Log AN = Un,8_.8,) j a 


but in view of a more comprehensible representation we renounce this 
generalization. 


Some conclusions following immediately from the above definition: 
h “ D -h 
(i) If (0° ,e") ~ (8,,9,), then (8" ,8') a (9, .8,)- 
Especially we have i 
1 e 


S h,h 
(it) If (0°,0") ~} (6,8) and (6,6) ~ (@,,0,), then (@',0") A *(e,.8,)- 


h h71 
(444) If (0',0") ~ (O 91), then (@,,0,) ~ (0'.0"). 


= 
h a h RI. 
(iv) If (@',0") ei (@,,0,) and (6,6) ~? (0,,0,), then (@' ‚@") 1 218,8). 


For any given sample size N w.r.t. Klee and any real h let 
SA be defined by 


h X 

L m L ’ 

N,Q 9 n,O ,@,° {Nan} 
oi 1 nef? o’ 1 


where 


h 
L = lim sup bn 0, 184 . 
n—> co 
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h 1 variabl 
Then LN,0, 0, is an (Fy % )-measurable random able (see [40] 


Theorem 1.5) and the following transformation rule holds for expec. 


tation values of (F 1.8") -measurable random variables in case of 


(8',0e”) Le (0, .0,)- 


Lemma 1.6.1. Let N be a sample size wort {Falne pte let 

= 2 2 

P:$L—R” be an (Ewe EI measurable and Pg"-integrable function, 
If (08',0”) A (0, .0,). then for every FE ar 


Eg (PLN 9 af {ne oof Elei Ege Lë Tue een (Eë), 
gy (1.23) 


Proof, We have 


Eg- (Xf ycooy lp) = Eorl PX wee | FoX F 
= Egr (PX (yc oof] F)PQn(F)- 1224] 


Since FE F y by [40] , Lemma 1.4, a sequence {Fa nert of sets FEF, 
exists with 


ES KR Xp x {N=n}° 
ner 


Further, since w is an (F y»%)-measurable function a sequence 
Je nIner* of (F „+ %&")-measurable functions Y,:2o Rt, ner’, 
exists with 


f = A+ Pn X {nan}' 


ne 
Hence, by (9',0”) A (9, .8,) we obtain 


kg CDe Ab 2 f PX rcdëe- 
nef * {Nan} 


s E, h 
v "ao, o X{Nc o0} X p) 
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h 
Eg. (¥ "Më, “(Ne co}! Pipo, (F). 


The identity (1.23) will be a useful device in connection with the 


investigation into the properties of sequential teste. Two special 
cases of (1.23) will be of particular interest. 


(1) IE PQ (N< œ) = A and Po (F)> O, then (1.23) with P = 1 implies 
h 
"e (twee, lF) © Bes (F)/Po: (P) . (1.25) 


(ii) If PS.(N<eo) si and Est, then (1,23) implies 


h 
Foe Pm Eo ANE degen, 
o) 

The subsequent lemma presente a conjugacy criterion for the 1,1.d.- 
cese considered in the Examples 1.2.1 and 1.4.1. We suppose thet Po: 
Fe and bé are determined like in these examples. 
Lemma 1.6.2. Let Kner? be a sequence of i.i.d. randos 
variables having a density F(x), where the set S = {xe X: f a(x) 7 OF 
does not depend on BE. If to any given 0',0",0,.,0, € ©, 0’ 4 97, 
e5 + ZE a real number h + O exists so that 


fe (lte, (x) = (e, rt, 00)" for xes, (1.27) 


then we have (@‘ ,0“) a (9, .8,)- 
P roo f. Under the conditions of this lemma we obtain for every 
pair ebe © and néf a version La ö 8 of dpa!) sapa(") if we put 


n 
bn 6,80) =] Irëtz e ae, (1.28 
i=1 


where in case of falx (w )) = O we can choose an arbitrary value for 
In,6,8- We consider the set N, e due IL: fo(X,(w))>o}, HE, 
ier*, By definition of S and the i.i.d.-property of (Xntner* ws 
obtain 2. = {we : dl IEN so that Le? does not depend on 
SEM and ier*. Hence, for w€ Q. we obtain by (1.28) and (1.27) 


for every nef" 
n 


tno or) TT (eat te: Data ))) 
Lei 
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h 
= (Fo (Cw) fo (X,(w))) 
ial . 
=L” (w) (1.29) 
ÉP 19, w D 
For we 1-0). La, go: 9 and La, e, 0, can be defined in an arbitrary 
manner. Thus, we achieve that (1. 229) holds also for well -N, . Hence, 


we obtain (1.22) and the proof is complete. WM 


This lemma can be modified for exponential families as follows. 


Lemma 1.6.3. Let {Xai nert be a sequence of i.i1.d. random 


veriables having the density 


fo(%) = h(x)exp(d(@)t(x) - c(0)) , xeX ‚9E ©. (1.30) 


Suppose that t(X,) hasa DON -DRDERAFA Pe distribution w.r.t. Pe 
for every BE ®@. Then we have (@',0" EA (6, .0,).1ff 


d(@") - d(@') = h(d(@,) - d(@,)) (1.31) 
and 
c(@") - c(@') = h(c(@,) - c(9,)) - (1.32) 
and 


Proof, We have (ër eo") £ (8, RI 1) iff versions Ta o ër 
of the Radon- ss orl? dpa) and dp§") sap") 
gi wi 


"n,8,.8, 
holds for a non- 


h 
exist for every ner” so that CH = "n,0,.9, 


zero h. Since the XT nert are assumed to be i.i.d. random variables 


ith d f h DEN d L f 
with a density o(*) we can choose e ox an n 8.8 or every 
neM* according to 
SE Tat, \/fg.(X,)) and 
i=1 
Bier? lut (%)) > 
i=1 
Then by (1.30) we have Li 4. g" = A ò e, nert, iff 
D a U oi 
n 
tátta,- SCHIER - (c(@") - c(@')) = 
"erg Zei em LI 
n 
pay) - d(@.)) BETH - h(c(@,) - c(8,)) , ner’. 
Na Lei 


et 
dëi inte ar~ underlined pe 


An aut TE wing equation Lä an 
inthe — under red part the her 


DnA eaaa Non CDN. 


Since £(X,) has a non-degenerated distribution w.r.t Po for 0 e0, 
this is true iff (1.31) and (1.32) hold and the proof is complete AN 


We notice, if (1.31) und (1.32) hold ,then we have further 


c(@,) - cl.) eigri- c(@') 


d(@,) - da(@,) d(@") - die‘) 


(1.33) 


This equation, together with (1.31) and (1.32), can be used to ade 
minate to given 8',0,0, EG) a 08*E® and an h an that (9',9” A 
(85° @,). Tasks of thie Ss will arise, e.g., im connection with an 
approximate computation of the power function of WALD’s likelihood 
ratio test. We refer to Section 2. We remark that the system of 
equations (1.31) and (1.32) to given HI as a system of equations in 
the unknowns 8" and h has the trivial solution 9” = 9' and h = O 

in each case. Indeed, this trivial solution will be of importance 
only if it is the only solution to the considered system of equations. 


Ex amp le 1.6.1. We consider some special cases of (1.30). 
(i) The Bernoulli distribution. We have 


fo(x) = o%(1 - OUT, xe<0,1} , 0€(0,1) . 
This implies 
c(@) = - In{1 - 8) and d(@) = In(8/(1-0)) , 


and we obtain the system of equations 


@,(1-0_) 
@“(1-0' 1 o 
In = h In Sy (1.34) 
and 1-0 
1-0" 1 = 
ln Io 7 h In 15: (1,35) 


according to (1.31) and (1.32). In general, it is not possible to 
find to given 9'E@ an explicit solution for h and gr, Indeed, 
(1.34) and (1.35) implies 
1-0'(0 /9, yh 1-0 
h = In a In — (1.36) 
o 


and this equation can be used to obtain to given gc a solution 
h + O by the method of iteration if | 
1-0, 9,(1-0,) 


1.37 
org: Inge, ln TI) ' ( ) 


-31 


Then, (1.35) implies 
1-8 
1 a" : 
8 e Le ( 1- o (1.38) 


it is not difficult to obtain to given h #0 a Paramgı 
er 


Conversely, ` S 
pair (@',9"”) with (8',0") ~ (8,194) It follows from (1,34) ep 


(1.35) if h+ O 

a 1-0 

CM EE SR (1.39) 

and @" can be determined again by (1.38). An explicit Solution to 
the system of equations (1.31) and (1.32) can be obtained if 

o =4-€ ande, = 5+ 


Then we obtain by (1.34) and (1.35) 


with € € (0,5). 


gn = 1 - Hi (1.40) 


1-0' 1+2€ 
h = an daR /in iie (1.41) 


for @'€ (0,1) and @' # @” = 1/2. 


and 


(ii) The Poisson distribution. We have 


x 
fo(x) = -= exp(-0x) , xer? , 0E (0, ©) =W 


and we obtain 
c(@) = @ and d(0)= Ing, 


Hence, by (1.31) and (1.32) we obtain the system of equations 


ln 0” - ln O' = h(ln 6, - ln ei (1.42) 


and 
(1.43) 


eo" -0' = h(@, - if 


It is not possible to find to given gr an explicit solution for h 
and ©“, but (1.42) and (1.43) implies 
= . h 
h = 0'((9,/8,) - 1)/(0, - @) . (1.44) 
This equation can be used to obtai 
n to given 0'€ | 
the method of iteration if RE 


gr A OI e ` 
+0 (8, 8,)/1n(@,/0,) . (1.45) 


Then (1.43) implies 
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0" = BI + h(@, ~- wi (1.46) 


otherwise, we can obtain for ever 


be? y non-zero h a parameter pair NW 
with CN yn AP 


Then (1.42) and (1.43) implies 
ICH aa) (9,70)? = 1) (1.47) 


and 9” can be determined by (1.46). 


(114) The normal distribution. we consider the mean and suppose that 
the varience 8“ An known. Then we have 


1 -@)7 
folX) = -= exp(- me), er! 1. 
e You eg ) , RER” , GER +) 


c(@) = e* 26 e and d(O) = 0/6 2 


with 


According to (1.31) and (1.32), we obtain 
gr - @' ew h(@, CD (1.42) 


and 


wé v SÉ 2 2 
Saisie - 0). (1.49) 


This example is one of the few examples, where to given 9' the sys- 


tem of equations (1.31) and (1.32) can be solved explicitly. The 
corresponding solution is 


d (8, + 8, = 20')/ (9, - wi e (1.50) 
oe" = h(@, - 8.) + O° ., (2.52) 


We note, that this solution does not depend on 62 and we have a 
non-zero solution for h iff 


40" = (0 + Q,)/2. (1.52) 
Further, (1.50), (1.51) and (1.52) implies 


ch = 20 = Ch e (1.53) 
(iv) The exponential distribution. We suppose 
f(x) = 8 exp(-@x) , x€(0,°>) , GE(0, ©) s 9. 


Then we have 
c(0) = - 1n0 and d(@) = -@ , 


According to (1.31) and (1.32), we obtain the system of equations 
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3 Eger, Tests 


-9" + Hi = h(-9, + 8): 


-1n 0” + In 9' = h(-in e, + In @,)- 
dentical with the system of equations 
r the Poisson distribution and here e 


This system of equations is 1 
h, gi, 0", 9, and @, like in the 


(1.42) and (1.43) obtained fo 


obtain the same relations between 


Poisson case. W 
Now we consider some further relations between @',0",8,,8, and h 
metric exponential 


-para 
in case of (9',0") & (0, 04) for the one-P 


family. 
iable with the density 


Lemma 1.6.4. Let Zu be a random var 
D xex e BE(8,8), (1.54) 


fo(x) = h(x)exp(d(e)t(x) - c(®)) 


functions on (8,8), d is strictly 


where c and d are analytic u 
1)? o for 9€ (8,8). For 


= 2 
monotonical in @ on (9,0) and Dot (X 
9,Ö€(0,5) let 6(0,6) be defined by 


5(9,6) = (c(@) - c(ö))d’(8) - (d(@) - d(@))c'(@). (1.55) 
We suppose A 
u geg, dP &(0,6) = 20. (1.56) 
Then we have: 
(i) To each gie 6 corresponds a 9" > @ so that 
(1.57) 


G(e',6) = 6(0",0)> 0. 
This correspondence is a one-to-one correspondence between the ele- 
ments of (0,8) and the elements of (8,8), respectively. 
(ii) For every pair (@,,0,), 9<9 < O,< ©, a uniquely determined 
parameter of, ECKE exists, so that 


c'(e" c(@,) - c(®,) 
~ d(0,) - de) (1.58) 
and S S 
6(9,,0") = 6 (9,,0") (1.59) 
holds. 


Proof. (i) We note that for the distribution family (1.54) 


= = 
SIS (1.60) 


2 d 
Dot(X,) = gg Egt(X,) 1.53) 


and 
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holds (see e.g. LEHMANN [53] ). Since DSt(x,) >0 for 9€e(9,9), we ob- 
tain by (1.60) and (1.61) c‘'(@)/d'(@) is strictly monotonically in- 
creasing in @ on (@ 91. Thus we have 


SARL 2 c' (ê) for 0<0<ĝ (1.62) 
d'(@)  d'(ĝ) 

and 
e'e) ~ s’(8) for ô< 0<. (1.63) 


d'(®) d' (8) 
Now we consider the first derivative of 6(0,6) w.r.t. @ and obtain 

6'(@,8) = c’(e)d'(d) - d'(@)c'(8). 
Then we have §' (ô, 8) = O and the liana ee (1.62) implies 

2'(0,6) = d'(0)d' (6) (242) - 2'(8)) <9 for 9<0<6. 

d'(@) d' Ch 

That means that L (0,6) is strictly monotonically decreasing in 8 
on (8,8). Analogously, we obtain 8(0,0) is strictly monotonically 
increasing in © on (6,0). Hence, &(0,6) as a function of O has one 
and only one minimum at 9 = 6. Then, by 5 (6,8) = O we obtain 
2 (0,6) >0 for every HA ô. Furthergn, the monotonicity properties 
of ei (8,8). the fact e (6,6) = O and (1.56) imply, for every ef 
0O<ö_< + co, there exists a uniquely et pair 9',9” with 
e<e'< 6@<0"<@ and £ (0' Ei = 5 (er ,0) =S >: Ss, ranges in 
(0, co) we obtain the proposed one-to-one Mee AN between the 
elements of (9, 6) and the elements of (8, p). 
(ii) By the Cauchy Theorem, a parameter Ə * exists for every pair 
8, KI CKA o<9,< ©, where © BACK and (1.58) holds. Since 
c "(@)/d" (8) is strictly monotonically increasing in © on (8, 8), 
is uniquely determined. By paa of ©, the equations (1. md 
and (1.59) are equivalent for @ = 9”. This completes the proof. W 


By means of this lemma we further obtain the following conjugacy 
criterion. 

Lemma 1.6.5. Let {x abner’ be a sequence of i.i.d. random 
variables with the density (1.54). Suppose that Lemma 1.6.4 holds. 
If to a given parameter pair 9,94: CAR ek O, the parameter Ch 
is determined by (1.58), then we have (0',0") © (0,04) iff 


5(0',0*) = 5(e",0")>0 (1.64) 


and , 
ENEE E (1.65) 


d(@,) - d(@,) 


h = 


Especially we obtain 
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R 
h> 0 for e<e'< (2) (1.66) 


and eg 
h< oO for oi 9'< 8 (1.67) 


t to 
P roof. The equation (1.64) 18 equivalen 
c'(0* 7 c(e") - c(9') (1.68) 
d' (e ) d(e") - d(@') a M 
and $(e' ‚e*)>o and 8 (o",0*)> O implies O° P 9 ne 8 dek 9 
Furtheron, since @* is determined by (1. 58), we have also 
c'(e*) „ ©(®,) " c(®,) 2 u 
t Si mme $ , 
Ae EICH - d(@,) 


If now h is determined by (1.65) then we obtain 


d(e") - d(@') = h(d(@,) - d(%,))- (1.70) 


This, together with (1.68) and (1.69), provides 


c(@") - c(8') = h(c(8,) - ¢(9,))- (1.71) 


Applying Lemma 1.6.3 we obtain (0° 0") & (9,84). 

Conversely, by Lemma 1.6.3 e: ër & (9591) implies (1.70) and 
(1.71) and h is determined by (1.70) so that (1.65) holds. Further, 
(1.70), (1.71) and (1.58) implies (1.68) which is equivalent to 
&(0',0*) = S(e",0*). Since h + O, we obtain @' # @", and therefore 
8(9',0*) = &(e",e*)>0 so that also (1.64) holds. 

In order to establish (1.66) and (1.67) we note that, according to 
Lemma 1.6.4 (ii) 9 <0*< 0, holds. Further, if 9<0'< gf, then the 
equation (1.64) and Lemma 1.6.4 (i) imply 0" >o*, Thus, since d is 
strictly monotonically increasing, we obtain by (1.65) h>O for 
e<60'< Ə*. Analogously, we obtain (1.67). ` 


We discuss some consequences of Lemma 1.6.4 and Lemma 1.6.5: 


(i) If for the family (1.54) to a given parameter pair 8, 8,, 
g<e,< 9,< ©, the parameter 0” is determined by (1.58) and if 
KF opt forms a sequence of i.i.d. random variables, then the 


logarithm of the likelihood ratio Zao go. = lnL can be 
written as CM) a 
n 
Z = (d(O - d 
nO, 8, (d(@,) - d(@,)) CS - n(c(@,) - c(®,) 
nl Ai 
Q (X,) - wë IR) rt 1.72) 
o’ Ga dr (o*) e ne ( 


with 
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d 
CD 


= d(@,) - d(@,). (1.73) 
Since Egt(X, ) = c'(8)/d'(®) for ie[*, we have instead of (1.72) 
also n 

71,8, 18, = 40,.0,( 2 1) - nE gt t(X, )) (1.74) 
If moreover (ër ër) a (8,9, ) holds, then we obtain by (1.33), (1.65), 


(1.73) and (1.72) 
n 


SNE - d(@")) > t(X,) = n(c(@") - c(e')) 


. "e, 9, oxy ) - d' ee 


n 
= hd, e (Drop ~ LICH) nef", (1.75) 
o’ 1 {sī 


so that in case of (0',0") & (8, ,0,) the logarithm of likelihood 
ratio Za, d gx is always proportional to 


Si ) -n ene”) _ SH ) - nE ett (X, I (1.76) 


Ch 
i=1 d (e 
If especially t(X,) = X 


1 and E eu = ©, then we obtain in case of 
(o ai A (@,,0,) even 


n 
“n,e',0" = hdo o (2 ` er d (1.77) 
o’ 1 f 
and 
on. c(8, ) - c(8,) 
une (1.78) 
(8,) = d(@.) 


(ii) Parameter Of introduced by the second part of Lemma 1.6.4 can 


be used to obtain a partition of the parameter space @) = (©, ©), 
according to 


© = (9, giele (e* 0), 


where in case of (or gr ) NICH ‚8,) (1.66) and (1.67) holds. Partitions 
of this kind may be of interest in connection with tests for the 
hypothesis 


8 2 
Ho? geg against H. SET 9*E (8,6), 


where in a sense parameter OË can be interpreted as a separating- 


parameter. For, it instead of parameters el and 0, this separating- 
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er Eh is given, the by Lemma 1. 6.4 a E of pairs ch ‚Br, 
9 <0'< e%< o" <6, exists so that 5(9' ,@ *) = 5(0",0 *) holds. Hence, 


by Lemma 1.6.5 and according to our above remark the logarithm of 
is for every pair O', H satisfying 


the likelihood ratio Zu @',0" 
S(e',0 *) =5(0" ‚o*) proportional to 
n 
> tx) .n c' (em) = t(X,) - nEgut(X,)- 
d’(e*) 
i=1 = 


This property will play a role in connection with so-called locally 
most powerful tests considered in Lemma 2.2.1. 


Exam l e 1.6.2. We consider the separating-parameters for the 


distributions of Example 1.6.1. 

(i) The Bernoulli distribution. We have Egt(X,) = EgX, = 9, c(@) = 
- In(1-@) and d(O) = 1n(9/(1-@)). According to (1.78), this implies 
f 

or O<@,,0,< 1, +9: 


1-0 9, (1-0_) 
9” a In — fin ti 0, (1.79) 
1-8, 9,(1-8,) 


i 
(oe SE and 0, SE, OCE<$, then we obtain 8" = 5. 
(ii) The Poisson distribution. We have Egt(X,) = Eo*ı = 8, c(@) sg 
and d(@) = Ing, Then (1.78) implies for 0<9 ,9,< co, 9, F Hu, 
x 

= (e, - 8,)/1n(0,/8,)- (1.80) 
(1ii) The normal distribution. We consider the mean and suppose 
variance e to be en: Then we have E EM ) = Eo%ı = 8, c(®) = 
=) 2/262 and gien = e/6? and we obtain Ge SS 78) 


= (0, + 0,)/2. (1.81) 


(iv) The exponential distribution.We suppose f o(*) = 8 exp(-@x), 


xE (0, Gel, 98€ (0, 29). Then we have E ot(X, ) = CO) = 1/8, c(®) = 
- ln O and d(®) = - O. Then, by E et (X, ) = c'(8)/d'(®) and (1.58) we 
obtain 


1. c(@,) - c(®,) 


ST d(e,) - d(e,) 
This implies for Oe 0591$ co, 8, $ ZE 
A 
= (8, - 9, )/1n(04/8,)- (1.82) 


We refer to (1.80). W 
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Some further consequences of Lemma 1.6.4 and Lemma 1.6.5: 


(iii) If Lemma 1.6.5 holds, this lemma can also be used to obtain 
to given parameters HR ‚8, e (9 91. 8 o 9: a parameter 8" and a 
value h so that (6° ,0") e. ‚8 1): In painy this, we have firstly 
to determine the separating. Kees e which satisfies by Lem- 
ma 1.6.4 (ii) the equation 


ongo) | ea 


d'(0*) d(@,) - d(@,) 
If @' è OË we obtain $(0',0*)>0. Then, according to Lemma 1.6.4 (i) 
there exists a 0"> Of which can be obtained as a solution to the 
equation 

Sie, &(e" ,o*). 
As a rule, this equation can be solved by the method of iteration. 
Finally, the corresponding h can be obtained according to (1.65) 


by 
d(@") - dg 


d(8,) - d(@,) 


h= 


Examples, where we may use this approach are, for instance, the 
distributions considered in Example 1.6.1. 


(iv) In many papers on sequential analysis the moment-generating 
( = 
function fz (t) of the random variable Z1 9 In L 


1,0, .0, 0°94 140,185 
defined for every eet by 
Pz 6,0, (1) a ies 40,7 SO = PS ES ER 


plays an important role. For instance, this function can be used to 
obtain the so-called WALD approximation for the power function and 
the ASN-function of WALD's likelihood ratio test for the hypothesis 
H. 6 = 9, against H,: H = 6, based on a sequence Xlner’ of i.i.d. 
random variables. In this context, we refer to Sections 2.1 and 2.7. 
Especially, a possible non-zero solution t = h to the equation 
P (t) = 1 
Z19091 
is then of particular interest. Between the solvability of this equa- 


tion and conjugacy the following relation holds. 


Lemma 1.6.6. Let {xy nert* be a sequence of i.i.d. random 
variables. Suppose that Lemma 1.6.3 holds. Then we have: 
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h 
(8',8") ad (85:81) then t= h i 


(i) If to given e',0",0,,0,€ (8,0) n 


a non-zero solution to the equation 
Eg-exp(tZ, 9.8, ) = 1. (1.93) 
the equation (1.83) has a non- 


(ii) If to given gi 9.8, € (8, 8), 
zero solution t= h, if a parameter 8" € (8,8) exists, where 


d(e”) = h(d(®,) - d(8,)) + d(8'), (1.84) 

then we have (a',e") & (8,84 )- 
h i ies L = 1," 
Proof., (i) (0',0") vw (0 91) implies Ly g: ‚gr = 1,0,,9, 
with h # O. Hence, we have 
h 
= = = E.,exp(hz 

1 = Egıly a’ ‚gr * Fo'lı,e ‚e, ” O PL 1,0,,0,) 
and t = h is a non-zero solution to (1.83). 
(ii) If t = h is a non-zero solution to (1.83) we obtain 

Font’ > RD Pa" 

Hi 9 1 H 1 
1 Oo 

Since 9" e (9,0) a density fo" (x) exists with 

fo" (x) = h(x)exp(d(@")t(x) - c(@")), se X, 
and we have 

h 
Soma) = Ire Ofo (ai Pe. fa läis (x). 
x 1 O 
x¥ 

This, together with (1.84), provides 

c(@") = h(c(@,) - c(8,)) + c(e'). (1.85) 


Then by (1.84), (1.85) and Lemma 1.6.3 we obtain CN = (0, ,0,) m 
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2. Likelihood ratio tests 


A test (N, Ai for hypothesis Ho? O = 9, against H,: H = 9, based on 
the sequence {Li e o,'ner* of likelihood ratios is denoted as a 


likelihood ratio test (LRT). The oonsiderations of Section 1 cancer- 
ning the sufficiency of the likelihood ratio sequence and its con- 
vergence properties for n— œo already emphasize the importance 

of the LRTs. For this reason, the following investigations are 
mainly directed to these tests. We shall see that many properties 
of tests as they are known for fixed sample size LRTs, see e.g. 
LEHMANN [53] , can be extended to sequential LRTs. 


One of the most important properties of a LRT for H. : O = 9. against 


Hw: @ = 8, based on Ma o, ower? is the fact chee. cf. sie 


1.3.1, we can restrict gur si canuion to that class of terminal de- 
cision rules depending for every nef" on the set {N = n} only on 
Lae ox Within this class of tests, above all such tests will 

” ; 


play an essential role, where also the sample size can be represen- 
ted only by means of the sequence of likelihood ratios. For a further 
classification of these tests we introduce the following notations. 


To any given sequences of real numbers {B Yner* and {Ay ert i 
O<B,S A n£ eo for ner*, let N and ó be defined by 


u inf {n> 1: ‘no, .0,¢ (BAL) } » if such ann exists, 


oo , otherwise (2.1) 
and 


ó = 
SCH 0 0,7 ^ne NS oo} ES 


We denote such an LRT by (N,6) = IL. o o BAY ert: 
DU e? 1 


A special version of this LRT is WALD's LRT (WLRT). Then, to given 


stopping bounds B and A, O<B<SA< ©, the sample size N and the 
terminal decision rule ó are defined by 


inf {n>1: ËM (B,A)} ‚if such an n exists, 
SS , otherwise (2.3) 


and 


de oe. nie (2.4) 


The properties of this test were systematically investigated by 
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A. WALD and his co-workere for the first time, and "P Se 
a , _ 
ding results are collected gl WALD's famous monograPp Es 


perties of teste of typ® (N, 6 KS LL. 9. oe! 
first 
sidered by wEISS [80] and KIEFER, WEISS "teil for the st time, 


B Anne rt were con- 


ider the logarithm of 


Sometimes it will be more convenient to cons 
be defined by 


‚Let Z 
the likelihood ratio bn 0,194 n,Q, 94 
+ 
Z e ln L b n er $ 
D. Ba 0,4 D, Bari 
and let ba and 8 be defined by 


+ 
- $ ner ’ 
b_ = ln Ba and an ln An 


respectively. Then we obtain instead of (2.1) and (2.2) 


e ry ch an n exi 
inf {n> 1: 71,0, 9, É (baran) Y if su xists 


N=] oo , otherwise 


and 
Gë E e, 8.2 ON’ N< eo}: 


Then we shall also write Gei -(z, 9 o Dy Ob nert: 
"oi 


Example 2.1.0. Let (N,d) = {tn,o,.o,®Aner* be a WLRT 
for Hj: @ = 9, against H,: @= 0, , 9, + 9,, based on a sequence 
of i. i. d. random variables {x Aaetz? CH density 


fo(x) = h(x) exp(d(@)t(x) - c(@)), xeX , oe ©. 
Then we obtain 


n 
(oe, ” exp((d(@,) - de.) > t(X4) - (c(@,) - c(8,))n) 
Lei 


“70,04 = (d(8,) - d(@ MSto ) = (€(0,) - e(0,))n , ner” 


and 


If b and a are defined by 

b = ln B and a =a In A, 
respectively, then we can describe the test (N, A ) = (tn, e. ‚8 ‚B Abnert 
as follows. We continue sampling as long as for n = 4 Ba the 
variables SÉ? satisfy the so-called critical inequalities 


b<Z <a. 
R (2.5) 


DRa 1 
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We stop sampling at stage n if 


Z Sb or Z za 
n,8,,8, n,8,,8, 


holds at this stage for the first time. If Zu o 9 <b, then we 
"oft 
accept hypothesis Ho’ in case of RRE) we reject hypothesis 


H. or accept H, (see Fig. 2.1), respectively. 


SÉ? l Acceptance of H. 


Acceptance of Ho 


Fig. 2.1 Graphical representation of a WLRT 


If e£ 84 and if d is strictly monotonically increasing in 8 on&® 
the critical inequalities (2.5) reduce to 


n 
sn + h, < t(X,) < sn + he, ner, (2.6) 
i=1 
where 
h, ee and he = a g (2.7) 
d(e,) - d(®,) d(®,) ~ d(9,) 
and 


8 - 8 
s = et = Pa s (2.8) 
CHEN 


The corresponding graph is shown in Fig. 2.2. 


Acceptance of H4 


Acceptance of Ho 


Fig. 2.2 Further graphical representation of a WLRT 
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n 


; EN 
Plotted in this plane and we continue sampling as long as these 


sample points are contained in the continue-sampling region. This 
region lies between two lines having equal slopes and the inter- 
cepts ha and hee | 

We notice, if Lemma 1.6.4 is applicable, then we have 


pal 
BAR néi? 


n 
z = (4(8,) = as, : 
n,e e, = (484) - dii 20) Sore) Le 


where the so-called separating-parameter 9* is determined by (1.58), 
Hence, by (1.58) and (2.8) we obtain 
s = c'(0*)/d'(0*). 
If, moreover, E,t(X,) = © holds, then we have by (1.60) even 
a 
s = 0 


so that for this case the slope of the acceptance line and the 
rejection line, respectively, considered in Fig. 2.2, is equal to 


the separating-parameter gf, 
Some particular examples (see also Example 1.6.1): 
(i) The binomial proportion. Let {x baer? be a sequence of i.i.d, 
Bernoulli variables with 
fo(x) = 0%*(1-0)*7*, xefo,1}., ae (0,1). 
Consider WLRT (N,Ö) = Lea, Brëller" O<0 < 0,< 1. Then, 


for every nef". we have 


n n 
9, > e 1-8, n- > xX; 
(Us 4) fi 
1-0 
(0) 


and S 
(in DU 1-0, 
Z -(in ln Dn zech 
n,a_,® i 1-0 
or" @,(1-0,) fi o 
and critical inequality (2.5) reduces to (2.6) with 
8,(1-8_) 8,(1-8_) 
h - ane /in u 3 hp = In A fin — g 
S Ə (1-04) o (1-04) 
and 
1-0 9,(1-0 
s = ln 2 fin 1 o) 
1-0, 9.(1-8,) 
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1 1 
If 8, =.“ € and 8, 2°53 LE with €€(0,5), then we obtain 


n 
Žo o DEER Ee) > x, - (Ing) n, 
g: a 
EA 
where Ee is defined by 
Be: (1#2€ )/(1-2€). 


Further, we obtain 


Na = in B/2 In Ee, h. = In A/2 In E: and 8 = 1/2. 


(ii) The Poisson mean. Let (Set + be a sequence of i.i.d. random 
variables with density 


folx) = (@*/x!)exp(-@), sei 9€(0,0°). 


Consider WLRT (N, ) = {L < oo, 
( ) Jee, 8 Alnept: KR Then 


r 
H 


n 
(04/04) 2*1 exp(-n(@, - 6.1 


and 


n 
SËCH = (1n(9,/8,))> x, = n(8, - Sch 
iad 


nei", and critical inequality (2.5) reduces to (2.6) with 


he = ln B/1n(8,/8,): he = ln A/In(8,/8,) and 


s = (8, - 8,)/1n(8,/8). 


(iii) The normal mean. Let oe be a sequence of i.i.d. ran- 
dom variables with 


2 
1 -9 
fo(x) d er), 8,x€ (- 02 ‚+ 00), 


where 6° is known. Consider WLRT (N,6) = {L 


na. .0, PAlner* 
-00<0 <0 e + ec, Then 


1 
n 2 
Ly HB. = exp wl _ Po X,- 4 g "e 
"ef"? 62 i 26° 
EN 
and 
%- Ba X o R d 
29.05.04 7 BE DX ein 
Si FYI 26 


nef", and critical inequality (2.5) reduces to (2.6) with 


d S (671n B)/(9, ge gl, d = (671n A)/(9, - et 


45 


and 
8 = (8, + 9,)/2. 


(iv) The exponential mean. Let{x } opt be a sequence of 1.i.d, ran- 


dom variables with 
F(x) = © exp(-Ox), xE(0,00), 9€E(0,%), 


e Kei 
Consider WLRT (N, Å) {no 0,8 ner +: 0<9,< 9,< ©. Then 
n 
n + 
Gap e, = (9 70,) oxp(-(9, a ADANE nef 
o’ 1 {=i 


Z 


n 
n.O 0; = aCe, = dE? + on 1n(@,/9,), 
i=1 


n€l*. and critical inequality (2.5) reduces to 


oi 


n 
sn + h,> >x, >sn + ho (2.9) 
i=1 
with 
ha = > (in BJ/le, - 8), h=- (In AAO, ~ 0) 
and 


s = (1n(0,/8,))/(8, - 9). 
We note that here H. is accepted or rejected as the lower or the 
upper inequality in (2.9) is violated for the first time. W 


The WLRT possesses a comparatively simple structure. Nevertheless, 
it possesses rather far-reaching optimality properties. In this 


context we refer to Sections 2,2 and 2.8. 


In view of the computation ot the characteristics of a WLRT, the 
so-called fundamental identity or WALD's identity used to be the 
main device in investigating the properties of a WLRT (see e.g.[77]). 
By means of this identity Wald obtained his famous approximations 
for the power function, the OC-function, the ASN-function and the 
stopping bounds of a WLRT. Here we do not follow this classical 

way but use the concept of conjugacy introduced in Section 1.6. 

by which more general assertions on LRTs and, especially WLRTs, 


can be obtained. 


2.1 The power function 


The power function and its counterpart, the OC-function, are the 
most important characteristics for assessing the statistical pro- 
perties of the terminal decision rule of a test. They provide 
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information about the probability of the acceptance of hypothesis 
H, or Ho’ respectively, at a finite sampling stage, depending on 
the parameter QEG) .The power function M(®) and the OC-function Q(9) 


of a given test (N, ó ) are defined by 


M(@) = EQ dX iy ceo} ' 9 € &), (2.10) 
and 

Q(@) = Egli - 8)X {N< co}! oO. (2.11) 
According to this definition, we obtain 

M(®) + Q(@) € 1, gef, 
where the strict equality holds for every geb iff (N, ó ) is clo- 
sed. If (N, Ai is a closed test, then it is sufficient to consider 
only one of these characteristics. 


It is a very difficult problem to obtain general assertions on the 
power function and the OC-function of a given test IN. A ) without 
any structural assumptions on sample size N and terminal decision 
rule &. Likewise the possibilities of the computation of certain 
characteristics of a test (N,&) essentially depend on the structure 
of N and &. We start our investigations with a theorem which provi- 
des relations between certain conditional expectation values and 

the power function and the OC-function for an arbitrary test (N,O). 


Theorem 2.1.1. Let (N,ö) be any given LRT for Ha: 8 = 8, 


against H © = @,. Denote by a and Fy the events of the accep- 


4° 
= C 
tance of H and Ha, respectively, where FFE Fy and FOF, G {N < oe}. 
If (0',0") & (0:84). then 


Ge (ue e (n<oo}| Fo) = Q0(e")/a(®') (2,32) 
and 
re (oe, e Line oo} F,) = M(8")/M(0'). (2.13) 


Proof. With YY = 1 by Lemma 1.6.1 we obtain 


h = 
Eg: (ly 9 ‚9 X {N< o0) | Fy) = (Pau (Fo )/Po: (Fo) Eo LE {Neol Fo? > 
E 3 (2.14) 
Then, by definition of the OC-function, we obtain 
Po(F,) = Egli - IK {yc wo} * (0), 060. 
Furthermore, since F; ç {N < 20) we have 
This together with (2,14) provides (2.12). Analogously we obtain 
(2.13). W 
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By means of this theorem we obtain the following general formula 
for the power function of an LRT. Denote by B(@',0") and A(@',0”) 
the left-hand sides of (2.12) and (2.13), respectively. 


Corollary 2.1.1. Suppose the assumptions of Theorem 2.1.1 


are fulfilled. If N is closed, then 


8 = , 8 z 
M(@') ee (2.15) 
and A(® ,0") = B(@' WW 

M(9") = A(@',0")M(@'). (2.16) 


Proof. IEN is closed, we have M(Q@) + Q(8@) = 1, 8 EQ. Hence, 


instead of (2.12), we obtain 
h 
Eg: lie eX {newpl al = D = Hei Mer). 
This, together with (2.13), implies (2.15) and (2.16). W 


Thus, in case of (e ei Äre, ,0,) the computation of M(8') and 


M(8") of any given closed LRT (N,ö) for H.B: 8, against H,: 


Ə = 8, can be reduced to the computation of the conditional expec- 


tation values 
(J i) h 
B(0',0") = Eg: (Ly o 9 IF) 
ge, Aen, 


and 
om h 

A(Q',O") = Ey: (Lug a,l Fo?” 
dë, Be 


2.1.1 The WALD approximation for the power function of a WLRT 


Applying Corollary 2.1.1 to WLRTs and taking advantage of the con- 
cept of conjugacy we obtain a formula for the power function of a 


WLRT as follows. 
Lemma 2.1.0. Let (n,d) = {tn 9 8 BAY opt be a closed 
' o’ 1 


WLRT, O<B<1<AC®. If (0',0") Æ (0,94). where 


Pa, = BIF = 1 e 
e (ue. a, 7 He (2.17) 
ane L AlF,) = 1 (2.18) 
Po. = = 1, . 
Ze E 1 
then 
M(8') = (1 - ei ya? - eh: (2.19) 
d 
an wech Abt - Beta) - BM), (2.20) 


P roo f. Because of (2.17) and (2.18) we obtain 
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h 


B(@' ,e") = B and A(9',0") e Ah ` 


Then, (2.19) and (2.20) follows immediately from (2.15) and (2.16) Œ 


Let M*(h) be a real function defined to given stopping bounds B 
and A, O<B<1<A<o , by 


(1 ebotah - B?) for -oo<h<+ooand h + O, 
M*(h) / (2.21) 


(- In B)/(1n A - 1n B) for h =a 0., 


Then M*(h) is a continuous function in h on (-09,+°0), and we 
obtain in case of (0',0") & (0,0) instead of (2.19) and (2,20) 
also Š 

M(@') = M (h) (2.22) 


and 
M(9") = M*(-h), (2.23) 


respectively. 
Of course, the assumptions (2.17) and (2.18) are quite restrictive. 
If, instead of (2.17) and (2.18), we only have 


Po (B -E< (ua, a, 2 B|F)=1 (2.24) 
and 


Po, (A< Lu. <A AE F,)=1 (2.25) 


Ban 
for any given sufficiently small € > O then, instead of (2.22), we 
obtain e h 
M(O') @ M'(h) if (8',08")w (9,9, )- (2.26) 


This is the so-called WALD approximation of the power function of 
a WLRT. We shall call B- LN,0 0 and ‘ne, ,0 - A the excess of 


1 1 
n at termination over B and A, respectively. If (2.24) and 


N0591 


(2.25) hold for a small € 7 O, we shall say the excess of Ly 9 e 
“o! 1 


over B and A is small for the given © eð. 


Example 2.1.1. Continuation of Example 2.1.0. In order to 
obtain the WALD approximations of the power functions of the tests 
considered there, we need the corresponding relations between ®' 
and h in case of (0',0") Ad CITE According to Lemma 1.6.3, we 


have (0° ,0") © (@,.0,) iff 


d(@") - d(@') = h(d(e,) - d(®,)) 


and 
c(@") - c(@') = h(c(®,) - c(8,))- 


For a given gi this system of equations can be used to determine 
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the required parameter h O if such an h exists. As a rule, we ob 
tain an iteration formula for h. Vice versa, if h+# O is given, : 
as a rule, the above systems of equations provides an explicit for 
mula for the corresponding gr, The detaile have already been vee: 
gated in Example 1.6.1. ts 


An example where the excess of LN ,0 40, at termination over B and 


A is zero at least for some values of the stopping bounds B anda 


is the following. 


Example 2.1.2. Let (N,ó)= {Un ,o_.e, ®Ainer* be a WLRT 


for 


` = a A H 1 1 
H,:0=0,=5-E against H,: 0 = 6, =% +E, 0<E<z, 


based on a sequence of independent Bernoulli distributed random 
variables (cf. Example 2.1.0 (i)). Then we have 
n 


N 
Zo e o.” ch, i+2€ Æ Xi e ee n, nef", 
Toi 1-2 i=1 1-2€ 
so that Z is an integer multiple of fga In((1+2€)/(1-28)) 
n,@,.8, 


for every nef*. Hence, relations (2.17) and (2.18) hold iff 
integers k and Kes kn<ock,. exist, where 


InB= k Er and ln A = k Ee . (2.27) 


The power function: According to Example 1.6.1 (i) (cf. (1.41) and 
(1.40)) we obtain (@',0") © (@,,0,) if 


h = 1n((1-0')/0')/ $e 
and 9" = 1 - 9'. Thus, by (2.22), we obtain 


1 (2) 


` T ( 5 for © T (2.28) 
Kä AS [28 a 
Ch Ch 


m(Q') = M"(h) = 


in case of (2.27). W 


where to any given geb a 9" + 9' does not 
We shall say then O' is an excep- 
r this situation we suppose that 


The case is still open 
exist so that (0',0") © (8,.8,)- 

tional point. In order to conside 
the following continuity assumptions are fulfilled. 


(i) M(O) is a continuous function of oe. pen 
4 * = @' there © 
(ii) For every sequence CHE A Ge with lim Sa gi the 
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a sequence ha a rt E® and a sequence {haner té rt with 
’ eo h + 
lim ha = h, where (9, ‚8 n) ell (85:891). d + 0, ne”, 
n — eg 
Then, if the excess at termination over B and A, respectively, is 
zero, by (2.21) we obtain 
' . ' : * % 
M(@') = lim M(0,) = lim M A = M (h). 
el Ch h— h 


If now for any given sequence {o-} Ee with ia En = ei we 
have lim h, = O, and if according to (2.21) for h = 0 M*(h) is 
n> oo" 


defined by 
M*(O) = lim M*(h) = (- In B)/(InA - In B) 
h—> O 


then, under the above continuity assumptions, we obtain 


M(8”) = lim CHE lim id = M*(0) 


8 —> 9 
n 


= (- In B)/(ln A - 1n B). 
Hence, if the excess at termination over B and A, respectively, is 


zero, we obtain the following parametric form for the power func- 
tion of a WLRT under the above continuity assumptions: 


(1 - B)/(A"- BP), af (0',0") & (0_,9,), 
wer =| 
(- In B)/(1nA - ln B), if or is an exceptional 
point. (2.29) 

We remark that the above continuity assumptions are fulfilled, for 
instance, for the exponential family considered in Lemma 1.6.4. 
For this family, the parametric form of the power function can be 
modified as follows. 


Corollary 2.1.2. Let (N, 6) = {Lie 10,'2 AT nent be a 


closed WLRT based on {x ala ert where Lemma 1. e, 4 holds. Suppose 


the excess of Ly o o Bt termination is zero. Then, for every 
1 
@'€ (0,0), we have 


M(8') = M*(h) with h = IT) - die’) (2.30) 


d(@,) - d(e,) 
where parameter O” is given by 


6(e',0") CNN 


and 9" denotes the separating-parameter given by 
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c'(e*) _ c(@,) = c(8,) 

d’(e*) d(@,) - d(®,) 
Proof, This immediately follows from Lemma 2.1.1, Lemma 1.6.5 
and the definition of M"(h) according to (2.21). 


If we may only assume that the excess of Lyg g Over B and A at 
"oi" 


termination is small, then (2.30) holds approximately and the right- 
hand side of (2.30) is again the so-called WALD approximation for 


the power function M(@). 


2.1.2 The WALD approximations for the stopping bounds of a WLPT 


Let (N,§) = {tn 0,0, P Atner* be a closed WLRT. If (2.17) and 
(2.18) holds for @' = 8, then (2.19) and (2.20) imply 


1-8 and M(@, ) k Lu 
A - B A - B 


CHE 


and to given e and RB, 0<&,8<1, we can always choose A and E in 


such a manner that 


EE a and A Ze, 1-8 
A - B A - B 


holds. This implies 
t B 

1-a 
D 


with O<B*<1<A*< © for«k+ Beil, If then (N, déi = AL a o, °° E 
2 oi 


ke 1-8 
d A = = 2.31 
an A S ( ) 


H í , 
A dE is closed and if 
AER 


x 
= B IF.) = 1 and Po (ly g D 
vg 9 (2.32) 


Pa AL 
0, N,0, 404 
holds, the power function of this test satisfies 


MƏ) = & and M(0,) = 1 - B. (2.33) 


i all, we obtain instead 
If the excess of Ly 9 o over B and A is sm 


1 
of (2.33) g 
M(B) M a and M(9,) * 1-B 
and the stopping bounds B* and A” , given by (2.31), are denoted 
roximations for the stopping bounds of a WLRT. 


as the WALD app 
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2.1.3 A test for hypothesis Ho? ge oi against H4: @> "A 


mme 


Let {X J opt be a sequence of i.i.d. random variables having 
density 

f(x) = h(x) exp(d(@)t(x) - c(@)), xex, 9 € (8,0) .(2.34) 
Suppose that Lemma 1.6.4 holds. Our aim is to discriminate between 
hypotheses 

H : ƏSƏ” and H,: 9>0% 9<o"<$,. (2.35) 

a A 

In doing this, we consider a test (N,6) defined as follows. To 
given stopping bounds B and A, O<B<1 <A< ee, let the sample size 
N and the terminal decision rule d be defined by 


inf 4n21: L (8,A) ‚if such an n exists, 
N = { d J (2.36) 
oo , otherwise 
and 
A 
= Km 3%, N< oo}: (2.37) 
where is given by 
L D 
ut = exp ( > tO) EE, , ner, (2.38) 
d'(@") 


i=1 
The heuristical background for choosing N and & in such a manner is 
the following. As already stated above, for family (2.34) we have 


Egt(X,) = c'(8)/d'(®), 9€(0,0), 


where c'(8)/d'(®) is strictly monotonically increasing in @ on (8,0). 
Then, for any given oe (8,8), we obtain 


Ei 
Egt(X,) - Eget(X,) < 0 for geg 
and 


Egt(X,) - Eget(X,)>0 for SET 


That means, if for sufficiently large values of n 
n 
> t(X,) .n Egrt(X,)<0, 
i=1 
then this is a possible hint to the fact that the true parameter © 


n 
satisfies 0< 9*. Conversely, positive values of SCH =- nEowt(X,) 
8 i=1 ” 
may be an indication of @°<@. This motivates the choice of N and 


AN 
ó according to (2.36). 
Test (N, 3) is a WLRT in the following sense. 
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% 
Lemma 2,1,1. Let (",5) be a test for Hai ape — H, 
Reg ees E EA é ö A 

0> 0", aco"< 6, defined by (2.36), (2.37) wéien $ e Suppose 
that Lemma 1.6.4 holds. Then, for every pair H: Se KN EM 


satisfying 


S(e',o') »@(e",0") >0 | (2.39) 
test ON. di is identical with test 
d ' o” dos gx 
(N, 6 ) = {en gr gn BH N ‚A eege (2.40) 
where 
de, gr = d(e*) - d(e'). (2.41) 


P roo f. According to Lemma 1.6.4, a continuum of pairs gr ‚g” 
€ (8,0) exists for every o"E(9,9) so that (2.39) holds with 
ge OR 8". Hence, a corresponding 9" 7 0* will exist for every 
@'< 9* so that (2.39) holds. For every pair 0',0"€ (0,0) satisfying 
(2.39) we have 
e(8") - c(@') _ c'(o* 
d(e") - d(e') HEEN 
Thus we obtain 


n 
La ox on = exp((d(e") - d(@")) > x, - n(c(@") - c(0')) 
` i=1 


n 
à %* 
exp((d(@") - d(e')) (> x, -n oe 
ini d'(9") 


= der) - de), ene, 


If now di es is defined by (2.41), then the critical inequality 


NM 


A A 


of test (N,d) is equivalent to 


Gin me Gn Ss 
e 88 dÉ 


< Log an SA 


nen’, Furthermore, inequality L SB is equivalent to L gor On < 
d EE 
8',9"” + A 

‚ nET’. Hence, tests CECR and IN. EI are identical. W 


An immediate conclusion of this lemme is that test (N, &) will have 
the same optimality properties for @ e @' and Q = 9" like WLRT (2.40) 
Consequently, the computation of the Characteristics of test (Ñ, 3) 
Gen be reduced to the computation of the Characteristics of WLRT 
(2.40). 
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we consider the power function Droi of (Ñ,$ ). 


a O 
Lemma 2.1.2. Let (N,6) be a closed test for H. @<e™ against 


di CET GE 0% 8, defined by (2.36), (2.37) and (2.38). We suppose 
that Lemma 1.6.4 holds. To any given 8'€ (9,6) let ©" be defined by 


6(e',e*) = So" ,e*). (2.42) 
Further we suppose that 
P..(L* = B|H_ is accepted) = 1 (2.43) 
D N o 
and e Pr 
Po (Ly = A|H, is accepted) = 1 (2.44) 


holds. Then we have 


Hoi = M*(dg: gn) (2.45) 
with 
de, g = Je”) - die’), (2.46) 


where M” is defined by (2.21). 


Proof. By Lemma 2.1.1 test (Ñ. 6) is identical with test (N,4), 
defined by (2.40). If to given ®' pẹ 9°" the corresponding ©“ is de- 
termined by (2.42), we have @” x 9°, and, likewise to the proof 

of Lemma 2.1.1, we obtain 


d 
v, RH RH 5 
Log: gx s (Lh) ner 
so that (2.43) and (2.44) are equivalent to 
Palk - RN H is accepted) = 1 (2.47) 
CM "CM o p ° 
and d 
a H Si 
Pg.(LN,o' ,‚o” a A H, ts accepted) = 1, (2.48) 


Denote by M(@) the power function of (N,&). Then (2.47), (2,48), 
(0',0") & (8',0"), (2.19), (2.21) and Lemma 2.1.1 imply 
d 


“ _ p 9',9” 
M(O') = M(@') = e 1-8 = M"(do, 9.) for ëng, 
H Ki d H e ’ 
a BB ep 8 
Further, if @' tends to gf from below, the corresponding 0” given 
by (2.42) tends to of from above, and we obtain lim Oe: gr P 
9'’— 9" N) 
Zong ep = O. This implies 
d 
A CNR 
M(O*) = lim Me‘) = lim 1 - B 
H ep `, REES 
o e" Go: e _ „a .e 


= (- In B)/(1n A - 1n B), 
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which completes the proof. 


| e th 
If instead of (2.43) and (2.44) we may only suppos at the e 


we obtain 
of Lu at termination over B and A is small, 


Hier a H (de, gr) 
' 8 the WALD appr 
instead of (2.45), which can be considered a pp OXdmatig, 


A, ê 
for the power function of test (N, )- 


N A 
unds B and A of 
We now turn to the choice of the stopping ge h B e PER 
(N, 6). In general, it will be not possible to choose and A in 


such a manner that for an arbitrary pair 0,19, € (8.9), kA 9. 
bie = D and We, s 1-8 
holds to given %,8, 0<&R¢1, & + B<1. The reason is that to gi- 
ven @"€(9,8) (2.42) holds only for selected parameter pairs O o 
Further, a test for testing hypotheses (2.35) should possess the 
following property. If the true parameter, say ®', satisfies EM 
then the probability of the acceptance of Bo should be larger than 
the probability of the acceptance of Ha: Conversely, if CMD 
the probability for a decision for H, should be larger then the pro. 
bability for a decision for H... Hence, if we may suppose that (N, 6) 
is closed, a reasonable requirement for our test is 
Wenn = 1/2. 


Then the stopping bounds B and A can be chosen as follows. 


Lemma _ 2.1.3. Suppose that Lemma 2.1.2 holds. If to a given ®', 


o <0'<0*, and &, O< X< 1/2, the stopping bounds B and A of (Ñ, 8) 
are chosen by 


A 1/d H EN 

d -(—+_) Es (2.49) 
and nen 

A = 1/6, (2.50) 


where H and dg: g» are determined by (2.42) and (2.46), respec- 


tively, then the power function M(@) of (N, 8) satis 


ËM 1/2 (2.51) 
and & 
M(O') = K. 


fies 


(2.52) 


Proof. For äi = 8" by (2.45) we obtain 


M(@*) = (- In B)/(In Â - In B) 


d we have M(@") = 4 A» 1/8 
and we have M(@") /2 iff A a 1/8, This and (2.45) imply 


aA ds hed ada, 
Hei, B O BH ai, gO KN 
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for every RI of. Hence, we have M(e') „oA Aff (2.49) holds. W 


We note that we obtain 

Hië = 1- oh (2.53) 
for the corresponding 0”, given by (2.42). 
If, instead of (2.43) and (2.44), we may only suppose that the ax- 
cess of A at termination over B and A is small, the relations (2.51), 
(2.52) and (2.53) hold only approximately and are again approximations 
in the sense of the WALD approximations. 


We remark that the above approach of the derivation of the power 
function M(0) of test (N,$) can be considered simultaneously as an 
alternative approach deriving the WALD approximations for the power 
function and the stopping bounds of a WLRT for the exponential fa- 
mily (2.34). An advantage of the approach considered here is, that it 
is not necessary to determine the conjugacy parameter h explicitlv, 


A further possibility of the choice of the stopping bounds for test 
A N 
(N, 6) is considered in the subsequent section. 


2.1.4 The slope of the power function 


Let IN, Ai be a test for hypothesis 

H: geg" against H4: @>o0%, 0<0*< 5, (2.54) 
with the power function M(®), OE (9,8). Then the slope of M(®) at 
8 = 8* is a measure for the discriminatory power in the neighbour- 
hood of Of. The subsequent lemma presents an expression for this 
slope if (N, 6) is a WLRT. Moreover, we shall consider a further 
method of the determination of the stopping bounds of a WLRT for 
hypotheses (2.54). 
Lemma 2.1.4. Let (N,4) = (tae a, 2 AIner* be a closed WLRT, 
9<@ <0 < O, based on a sequence of i.i.d. random variables having 
density 


1 


Fo(x ) = h(x) exp(d(@)t(x) - ¢(@)), xe X, 90€(9,0). (2.55) 
Suppose that Lemma 1.6.4 holds. Further, we suppose that 


p 


L = B| Ho is accepted) = 1 (2.56) 


el NG 8 
and o 1 


Pa (L = A| H, is accepted) = 1, (2.57) 


( 
Ə' N0 9, 


5 * 
for @€E (8,0) and that the first derivative of M(8) at 9 = 9 exists, 


where 9” denotes the separating-parameter given by (1.58). 
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Then 
+ 
d'(0@ 
—inAlnB 42), (2.58) 
ln A - In B d(@,) - d(®,) 


9-9” 


m'co“. = Se) 
do 


P roo f. Under the conditions of this lemma the power function 


is given by (2.30). This parametric form implies 


— we KR dh 
do’ "MM dh hat de’ 
with h = (d(@") - d(@'))/(d(9, ) - d(8,)), where the corresponding 


©” ie determined by se'e") = 6(0",0"). Since 
-ln B , 1 _In Ain 8 4 4 o(h) for no 


(2.59) 


gr 29” 


M*(h) = 
In A - ln B 21nA - In B 
we obtain 
A 
dM (h) . 1 ln A ln B (2.60) 
dh h=0 2 In A - In B 


Now, if Lemma 1.6.4 holds, for every sequence {eo} \emreta.e*) with 
lim ©‘ = @* we obtain corresponding sequences {oryner? e (9* ,0) 


n— co 
and {ro sner* €(0, ©), where or and Ng: are determined by 


o',o* = gs 9" 
and Kik 5( n ) 
be, = (d(O7) - d(05))/(d(94) - 4(@,)). 
so that a 
lim Ep = 9" and lim ho: 
n— eo n= 2 "pn 


If instead of {O°} opt sequence {or} opt € (9* ,9) is given, a 


corresponding sequence horIner* exists so that 


ho» = (d(@") - d(@"))/(d(@,) - d(@,)) = - ho; nett, 


Hence, we obtain _ 
ho» = Ao. 


dh n n 


u 
m 
ji- 
3 


2 4m der) - d(e‘) 
m ei? Am, EE i 
d(@,) - de) n or - oF 


= - 2 d'(0*). (2.61) 


d(8,) - d(e) 


Collecting together (2.59), (2.60) and (2.61) we obtain (2.58). W 
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If (2.56) and (2.57) holds only approximately, the right-hand side 
of (2.58) provides an approximation for the slope of the power func- 


tion at @ = oi. 


Example 2.1.53. Continuation of Example 2.1.0. We consider the 
slope of the power function at @ = Of and assume that the excess of 


L at termination over B and A is small. 
VC 


(i) The_binomial proportion. We have d(8) = 1n(9/(1-9)) and the 
separating-parameter oi is determined by (1.79). Then, by Lemma 2.1.4 
we obtain 4 


8,(1-0) 
M'(@*) w - Jo Ain B (In 0 i, (2.62) 
In A - 1nB O (1-9, ) 9*( 1-09") 

(0) 1 


If we consider hypotheses 


H e = = ~ H H = = — + L — 


then we have ef 1/2, and (2.56) and (2.57) at least hold for some 
values of B and A (see Example 2.1.2). Under this additional assump- 
tion by (2.58) we obtain the exact value for the slope of M(®) at 
e* = 1/2: 


-1 
mel) a - RATE alte 1+2€ (2.53) 
2 

In 4 - In B 1-2€ 


For small values of £ we have I1n((1+2€)/(1-2€)) = 4€ and (2.63) 


implies 
Mh to A Sn B_ 41 tor Gap, (2.64) 
ln A - ln B 2€ 


(ii) The Poisson mean. We have d(8) = ln © and of is determined by 
(1.80). Then we obtain 
1 
M'(O*) a% __tn A ln B ` (2.65) 


ln A - ln B 8, - @ 
1 el 


(iii) The normal mean. We have d(®) = e/6° and Of is determined by 
(1.81). Then we obtain (2.65) again. We note that this approximation 
does not depend on variance 6“, 


(iv) The exponential mean. We suppose Tel sl = © exp(-Ox), x €(0, ©), 
€ (0, 009). Then we have d(®) = - @, of is determined by (1.82), 


and again we obtain (2.65). W 


AI 
Now we shall return to the test (N, &) of Section 2.1.3 for hypothe- 
sis H: 850" against H,: 9>9@* defined by (2.36), (2.37) and (2.38). 
Then the formula (2.58) can be modified as follows. 
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A 
Let (N, 6) be a closed test for H. De ey 
2.38). Wes 
(2.36), (2.37) and "Dose 


Corollar y 2.1.3. 


against H: @> Oe defined by 
that 


% A 
ccepted) 
Polti B| H5 is accep 


and k a 
Poll, = A| H3 is accepted) 


1 (2.67) 
for 98€ (9,6) and that the first derivative of its power function 


M(@) exists for O = 9*. Then 


Gren = Me) SS in A In Ë def). ER 
de * InA-1nB =e) 
Hab 


Proof. It has been shown in the previous section that test (N, 


A ,e" d 
is identical with a WLRT (N, ) = {Ly e ‚gr 8 Gre ‚A Zeg Kam 
9", where to any given gi, O<Q'< ot 


is given by (2.41), 


for Hə: 9 = gi against H,: O = 
parameter Or is determined by (2.39), 


and di g" 
Denoting by M(@) the power function of (N,ó ) we obtain M(@) a Mie. 


@€(0,0). Hence, applying Lemma 2.1.4 we obtain 


`. anu „Gar a» 


HM = M'(0") a - u A EU ee 


„In: - dan, u Gai UI 
ina HB _ inĝ e H Hp 
„. nA Ip P d'(@%), 


In A - ln Ê 
which completes the proof. W 


Under the SEET of this corollery, the slope of the power E 
tion M(@) at @ = @” of test (Ñ, ĝ) for H,: @$0" against Mi ZEIT 
will depend beside B and A only on the aiden parameter 9", This pro- 
perty will provide a further possibility for the determination of 


the stopping bounds B and A. 


Corollar 2.1.4. We suppose that Corollary 2.1.3 holds. Let 


d'(e")>O. If to given m*, O<m"<eo, the stopping bounds B and A 


are chosen by 


B = exp(- 2m*/d'(o" 
ond i )) (2.69) 
A = 1/8, (2.70) 
then the power function M(@) of (N, d) Satisfies 
Mer zi 
and A + 
M'(8") = m*. (2.72) 


ä % 
Proof. ‘For gi sg, by (2.45) and (2.21), we obtain 
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M = (- ln B)/(1n A - 1n B) so that we have dw = 1/2 iff 
A = 1/B. Hence, by (2.68) we obtain 
m0") — In B d’(e*) 
N % e 
and requirement M'(8”) = m" is equivalent to (2.69) .M 


If anexeee of (2.66) and (2.67) we may only suppose that the excess 
of E at termination over B and A is small, then the rignt- -hand si- 
des of (2. 69) and (2.70) provide approximations for B and A such that 
then df ) approximately satisfies requirements (2.71) and (2.72). 


We remark, that sufficient conditions for the existence of the first 
derivaraye of the power function of a closed sequential test (N, E ) 
at @ = 0” have been considered by ABRAHAM [1] and BERK [13] . These 
conditions are fulfilled for the distributions considered here. 
Furthermore, ABRAHAM [1] has shown that 


dln f,.(X ) 
dM 9 z E xs with S 2 —_ 8 n, n ` nef*, 
do wv © N n 3e e 
8=8 0=0 


This equation is obtained formally from 


dM(@) -2e dX d. A 
guo* 40 Ge, 9.0" 


do 
by differentiating across the expectation sign. We refer to Ee 


2.1.5 Upper bounds for the true risks 


We again consider WLRT (N,6) = io 9 o BAY opt: For any given 
$ oi 


1 
parameter pair gr ër €@ with (0',0") © (0 _,8,) and bio let œ (@') 


and B(@") be defined by 

%(@') = M(0') (2.73) 
and 

B(e") = Q(e"). (2.74) 
We shall denote X(@') and 8(@") as the true risks of our test at 
O = @' and 8 = 6", da keene a Especially,if 0' = 9, and O” = el 
holds we have AH 10,) (8, Bil, and the true risks X(@,) and B(8, ) 
are the usual proba E of an error of first and second kind. 


Lemma 2.1.5. Let (N, ó) = JL o. ae ,B Alner* be a closed WLRT. 
If (0' ei ie, ‚@,) with h?0O, Ehe 


o(@') + SCH B(e") < 1 (2.75) 


and h 
A oX(8') + B(80") < 1. (2,76) 


P roof. Since (N,d) is closed, by Theorem 2.2.1, (2.73) and (2.74) 
we obtain 


Borie, GD Xin oo | H is accepted) = ß(8")/(1 -&«(0' 
and ' o’ 1 oot] Hg SE ESA 


i (2.77) 
Eg: (L x is accepted) = (1 - B(®"))/c&(@'). 
a'(tn.a ‚eo, {N< coh] Hy Gei 

Otherwise, since O<B<1<A< © and h>O we obtain 
h i h 
Eg:(L\,o o X {N< scil Ho is accepted) < B (2.79) 
and o' 1 
h l h 
Eg(In,o ,0,% {N < eo}! e Dog accepted) > A . (2.80) 


Collecting together (2.77) until (2.80) we obtain (2.75) and (2.76). ® 


The consequences of inequalities (2.75) and (2.76) are shown in 
Fig. 2.3. The true risks must belong to the shaded quatriliteral. 


ß(e") 


-h 
. A 1 10 ) 


Fig. 2.3 Possible domain of the true risks &(@') and ß(0") 


This implies the quantities AH and B” are upper bounds for the true 
risks &(8') and ß(0®") and we have 


h 


a(o) e AH and B(er)<B (2.81) 
1 
in each case. Especially, since (05:94) e (0, .8,) we obtain 
K(8,) S Dee and ß(8,) 2 B. 
That means, to given & and B, O< X,B <1, the choice 
e and B=B (2.82) 


is sufficient to obtain a test with M(8,)s a and M(8,) % 1 - B. 


we notice that for oO<B<1<Aa<C® and h? 0O by (2.77) until (2.80) 
we still obtain the inequality ` 
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Bel < 1 Bier), (2.83) 
1 - «(0') x(0') 


which is equivalent to 
X(8') + B(0"”) < 1. 


Therefore, line «(@') + B(O") = 1 is an absolute upper bound to the 
possible domain of the true risks of our test. 


2.1.6 Bounds for the power function 


The bounds tor the true risks of a WLRT considered in the previous 
section can be used to obtain two-sided bounds for the power function. 


Lenn s 2.1.6. Let (N, ©) = {'n,9, 0, Bletz = closed WLRT. 


Then for every HI e®) with (0',0" H (8, ‚9 1) we have 


max{0,1 - B” "De M(8')< min{1,A” o. (2.84) 
P roo f. By (@',e") a (05:891) with h>O and (2.81) we obtain 

weie A and me") > 1 - B”, 
If (@' en (9,.0,) with h< O, we obtain (9",0') vw CH ‚,) with 
ech > 0. PTE 2. 81) again, we obtain 

M(@”) < an and M(0') 2 1- ech, 


Furthermore, we have O£M(9')<1 for e'e®., Collecting together 
these inequalities, we obtain (2.84). W 


Inequality (2.84) can be improved if additional assumptions are ful- 
filled. Two cases may be of special interest. 

(i) We suppose Po‘ (LN EE) = B | H. is accepted) = 1 for ee: 
That means we assume that only the excess of Ly 9 o at termination 


1 
over B is zero. For instance, such an assumption can be fulfilled 


for certain WLRTs concerning the binomial proportion or the Poisson 
mean. We refer to Example 2.1.4. Then we obtain the following two- 
sided bounds for the power function. 


Lemma 2.1.7. Let (N,6 ) = {L 9 o BAY. opt be a closed WLRT 
where MN 


Po’ (LNO 0, = B| H. 18 accepted) = 1 for ee, (2.85) 
Then for every Or ei with (9',0") A (9, .9,) we have 
max{0,1 - BP}EMm(o')S M*(h) (2.86) 
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at 
where M is defined by (2.21). 


Proof. By (2.12), (2.73), (2.74) and (2.85) we obtain 


is accepted) = 8(0")/(1 -x&(0')) 


h 


h 

Eu (L H 
9 N,0,,0,%4N < co} | o 
= B , 


respectively 

erer), B"B(e") = 1 
so that point (x (8'),ß(@")) belongs to the finite line between the 
intersection point (0,B") of the straight line, given by equation 
(2.87), with the 8(0")-axis and intersection point 


h h 
S -( 428 B” a? (2.88) 
h 


AM a p” a -B 
of the straight lines given by equations (2.87) and (2.76). Compare 


Fig. 2.3. For (@',0*) © (O ,0}) with h>O this implies 


(2.87) 


oeeiigieti- B")/(a” - B”) = M*(h) 


M*(-h) = BMAD - 1)/(a” - ebe B(0") <B” 


or 
O€EM(O')EM”(h) 
ane h h,.h h bh x 

1 - B'S M(0")<$ 1 - B(A" - 1)/(A" - B') = M (hi, 


respectively. Analogously, for (a',o") A (9,9, ) with h<O, we obtain 


O $ M(0") < M*(-h) 
and ai a 
1 - B "<gm(0')< M*(h). 
Collecting together these inequalities, we obtain (2.86).@ 


Hence, if (2.85) is true the WALD approximation M*(h) for the power 
1)’ An 


function M(@) is an upper bound for M(®) if (0',0") ~w CR 
analogous result that contains a corresponding lower bound for M(®) 

can be obtained if CHAT? = A| H] is accepted) = 1. 

Now, inequality (2.86) can be used to obtain values for the stopping 
bounds B and A of (N,ö) = tin,e_,o,'PAlner* so that M(9,)£ & and 


M(8,)? 1 - B holds to given X and B, O<a&,ß<1. 


C.0,F 0.1 I ar 2.1.5. We suppose that Lemma 2.1.7 hoids. If to 


given & and B, O<%,B8<1, K+ B<1, the stopping bounds B and A are 


chosen by 
B = B and A = t= 8 +0 P (2.89) 
(2.90) 


then we have M(@,) $ X and M(0,)21 - B. 


64 


p roo f. Since (0,04) © (99:94) by (2.86) we obtain 


M(@,)<M"(41) = (1 - B)/(A - B) 
and 

M(@,) 2 1 - B. 
If we put (1 - B)/(A - B) =œ and 1 -B= 1 - B which is equivalent 
to (2.89), we obtain (2.90). = 


We consider an example, where assumption (2.85) holds at least for 
some values of B. 

Example 2.1.4. Let (N, ó) = dE, 
WLRT based on a sequence {x Iner* of i.i.d. random variables having 


density 


+ be a closed 


fo(x) = h(x) exp(d(@)-x ı - c(@)), sel", € (9,0). 


Then we have 


L 


n 
ano 7 emp (4(93) - KODA - n(c(@,) - c(9,)) 


and n 
SH? = IC - d(8,)) DR - n(c(®,) - c(e,)): 
i=1 
ne r*. We suppose that an integer gef” exists so that 


d(@,) - 4(@,) = g(c(®,) - ¢(8,))- (2.91) 


This condition may be fulfilled, for instance, for special WLRTs 


concerning the mean of a Bernoulli or Poisson distribution. Then 


+ 


n 
KE - n)(c(8,) - c(8,)), nel. 


i=1 


2n,9 ‚8 = (g 
o’ 1 


and Z is an integer multiple of c(8,) - c(@ ) for every ner’. 
n0581 1 O 
If we further may suppose that 
c(0,) ~ c(8,)>20, (2.92) 


then for every B, O<B<1, an integer ke E P* exists with 


ky = max{keP*: -k(c(@,) - c(@,)) €1n B}. 


and we have 
21,0 ,,8, = - k,(c(8, ) - c(8,)) on {N = non. is accepted} 
nef, Hence, we obtain | 


HAS EN? = exp(-k„(c(8,) - c(@,))[H, is accepted) = 1 


so that Lemma 2.1.7 and Corollary 2.1.5 is applicable if 
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B = = 
exp(-k„(c(8,) - c(®,))- 

W 

A remark that under conditions (2.91) and (2.92) test (N,6) 
n,8.0,'B’Alner* is identical with test ! 


(N, 5) = ae, 10, enpicheli lgl = aM Aler: ll 


(ii) The symmetrical case: We consider test (N,&) = IL B 
and suppose that dE 


B = 
Se 1/A | (2.93) 
(8°) = B(0") for (0',0") % (8,.8,)- (2.94) 


Then we obtain the following bounds for the power function. 


.1.8. L ( 4 ) 8 8 e GK be a closed 


i x 
u M(e')£ M (h) for hat (2.95) 
M(9')£ M*(h) for h<O (2.96) 
where M* is defined by (2.21). 


Proof. If (2.94) holds, then point (x(0').,B(0")) is a point on 


the finite line given by points (0,0) and S, where S is defined by 


Se’ M 
(2.88). This, (8',0") SÉCHER with h>? O and (2.93) imply 


aerer) neie patt + B”) = M"(h) (2.97) 


and h b 
oe B(0") = 1 - Mer)eB/lı + B ) = M*(h), (2.98) 
rf (@',0") © (0 ,,0,) with h<0, 


where (2.97) establishes (2.95). 
) with hat, Applying (2.97) and 


then we obtain WW F (8,94 
(2.98), we obtain now 


oga(e") = HIH JS By SCH 


) = M*(-h) 


- 


and 
og a(e') = 1- m(e')<B /(1 + ech = m*c-n). 


This and M*(h) + M*(-h) = 1 provide (2.96). W 


WALD approximation 
h 

N CR 
with 


the conditions of this lemma the 
ound for M(@') if NW 
r mio‘) ACHEN D (9, oi 
be used to obtain 4 WLRT 


Hence, under 
M (h) for M (@') is an upper b 
with h>O and a lower bound fo 
h<o, respectively. This property can 
that is admissible in the following sense. 

a 2.1.8 holds. If to gi” 


2.1.6. Suppose that Lemm 
N, ó ) are chosen by 


Coroll lar 


ven od. < 1/2 the stopping bounds B and A of ( 
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| 


negt 


given X<1/2 the stopping bounds B and A of (N, Ai are chosen by 
B= &/(1 - oi and A = 1/B, (2.99) 


then we have 
M(®) < GC and WE 2 1-0, (2.100) 


P roo f. Applying Lemma 2.1.8 it follows immediately from 
CHE M*(1) = B/(1 - B)< BR 


We note that for the symmetrical case considered here the stopping 
bounds (2.99) proposed by this corollary coincide with the corres- 
ponding WALD approximations. An example for this symmetrical case 

is a WLRT for the normal mean with known variance and equal proba- 
bilities of an error of first and second kind, respectively. 


2.2 Most powerful tests 


Let (N, A ) be a test for H. O = H. against H,: H = 9,» Then the 
properties if its power function M(8) depend on sample size N as 
well as terminal decision rule d. Here we investigate a possibility 
to exert an influence on the power function by a suitable choice of 
the terminal decision rule if sample size N is given. We shall see 
that special LRTs with quite a simple structure of the terminal de- 


cision rule are best tests in the sense of the following definition. 


Definition 2.2.1. (i) A test (N,d) for H. H = 8 against 
H,: 9 = Ə, is said to be a test at (significance) level e, O <&<1, 
iff 

M(@,) = Ey ÉX (ue oo} * (2.101) 
(ii) Let #y(N) be the set of all tests (N, ó ) for Aa : @ = H. against 
H,: @ = @, at level & at sample size N. A test (N, 8 ye Ze (NI is 
said to E a most powerful test (MP-test) at level « iff 

Men E. 5X a sup En, 6X .(2.102) 

an Pep TANS Oy oy E je Fae (Ny Ca (NE Oh 
A 

According to this definition a most powerful test (N,d ) at sample 
size N maximizes the probability of acceptance of the hypothesis 
H,: O = 6, for @ = 9, within the claes of all test (N, 6) at level 
e, The subsequent theorem shows that the well-known Lemma of NEY- 
MAN and PEARSON (see e.g. [53] ) which characterizes the structure 


of the decision rule of a most powerful fixed-sample test can be ex- 
tended to sequential tests. 
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Theorem 2.2.1. Let (SL,F ,? ={P,,0€@}) be a statistical 
structure such that a non-decreasing sequence (F Inert of sub-6 ~ 


algebras of F and to given 0,.9,€ ©, O, + 9,. the corresponding 
seauence th. üo Iner* of likelihood ratios exist. Let N be a 
ae = Se | 


Stopping time w.r.t. {F Jnert with 


Po (N<o) soi > 0 (2.103) 
O 


A 
Then for every e, 0< K< GN an MP-test (N,6) at level & for H. (e) 
= u against Hy! H = 0, exists, whose terminal decision rule A is 


given by 
A = x + geb 
L >» Cx L Pr : 
{ N,0, 0, jj d N,0,.0, cat 
where Cy, O£c«< Ge, and Yu, O< ¥xu€ 1, are constants determined by 


mo, 
(2.105) 


(2.104) 


Pa (L > Cg, N< 0) + Ze P (L = Cy,N< 00) 
8, NR. 8, RK. N0591 


P r oo f. We consider the probability Pa (L 3 z,N< o0) as a 
RH. N,0,.9, 
function of z, O€z2< 06°, This probability is a non-increasing func- 
tion of z with P, (L 20,N< 00) = Pa (N < oe) = e". so that for 
8, N,0, 9, 8, 
any given &, O<&X Da real numbers cy, DëCed O°, and Ze, OF Yu $1, 
exist with 


Po (L > C:N< co) + YP, (L = c,,N<oo) ac, 
85 N10, 84 9, dée et S (2.106) 


A 
Then, for the power function MCO) of (N, ó ) we have 


Mca) = Eo OX ine ech 


E + ELX 
9X {Luo 0,7 Cy N < 00) de e {in 8 e, R GG Gi oo} 


Pg (L > Cu ı NEO) + YaPa (L = c,,N< oo) 
e CHE 0, N,8,.8, e 


= & 

A 
and (N,6) is a test at level &. Let now IN. Ai be any arbitrary 
Ə = @ against H,: @ = H, at level & with the power 


test for Ho? 
function M(@). Let JL be the set defined by 


fe A SCT $> ó ‚N< oo} ° (2.107) 


A 
Since OF 6 <€ 1 we have 6> 0 ont? and therefore Lyo g Z Ge on Oe 
ge, Ae, 


This implies 


7 + 
(ó - dE? - Cy)%?O on SL". (2.108) 


Let © be defined by 
N” = {G65 , N< 20}, 


(2.109) 
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Since 0<$<1 we have 6<1 and therefore Ly 
also implies 
(8-8 )(L 


N,O,.0, ” c„)>0 on O°, (2.110) 
Putting together (2.108) and (2.110) we obtain 

(3 - JLN a, 0, - c«)20 on DEL, (2.111) 
This implies 

Eg ((8 - dE Š Ce {y c eag) >0. (2.112) 


Otherwise, we have 


Eg ((6 - ne .e, T Ca) Xi ne ec 


a E 7 - a T Š 
o ló ó JLN o. af {uc ech ug (3 SIX Ly cosh: dere 


A A 
Bince Cie N< od} = WK =œ and (N,4) is a test at level of » we 
obtain 


Eo (8 - ÉX Lu coc * M(@,) - M(@,) 30. (2.144) 
Further, applying Lemma 1.6.1 we obtain 
Fa f° = ó JLN 0 ‚0, X {N< o} - Ze A X {N < 20} u Eg bX {n < oo} 
‘ Hie.) - M(0,). (2.115) 


Collecting together (2.112) to (2.115) we obtain M(e,)> M(@, ) and 
(N, ô) is an MP-test for Ho? O = @ against H,: 0 = 8, at level xt. ei 


We remark that the terminal decision rule $ of an MP-test for Ho : 


0 = 8, against H4: O = el proposed by this theorem can also be 
written in the form 


Ó = >, É n% {Nan} i (2.116) 


ne 
where Ón is defined by 
A. =X + YuX sahne, (2.117) 
n Aan, 8.7 Cu} GEN 2. 


Particularly, like in the non-sequential case if "e, (Ly, o o.” c)=0 
o’ 1 


for every c, O¥c< °°, the MP-test (N, 8) for Ho: e = @, against H,: 
A 
O = 84 has a non-randomized terminal decision cute Ó. If, on the 
other hand, Ly 9 e is a discrete random variable, the terminal de- 
b oi 4 


cision rule of the MP-test is strictly randomized at least for some 
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stants c 
values of o, Of course, direct computation of the ae re 
Y«is difficult and will depend on the possibilities g 


of L . We consi- 
corresponding assertions on the distribution N,8, ‚8, 


der the following example. 


The uniform distribution. Let (aer? be a 


Exam p le 2.2.1. 


seauence of i.i.d. random variab 


GG (o. ei or {x4 oa sek, @8€(0,@). 
G 


les having density 


fo(lx) = 


Consider a test for hypothesis 


H. H = 9, against H.: 0 = edit 0<9,<o,< oo, 
Then we obtain T 
X {x elo,a,]} X (x,¢(0.94 
k = (9 _/9,) o 
GK el 1 


and because of the {x ner’ are i.i.d. 
n X {x e [0.0 i} * (x,¢ [o.e,)} 
= | | (0,79,) 


"np. 9 
o 
i=1 x (1-X 
n = 

BEER Losst XEO {max X] ....,%,)50,)) 

= ( of 1) 
nef". We remark that this example is one of the few examples where 
the likelihood ratios La, Ə 6, turn out to be discrete,even though 


the NR are Bones. 
Now consider a test (N, A: where N and ô to given a>O are defined 


b 
7 B {n21: ei 9 9 € (0,a)} ‚ if such an n exists, 
ge Ka, 
N = 


SS , otherwise, 


ó = X + X 
Vue oi cy sNcooy * P Las e = cy,N< sel 


where cy and fe are constants still to be determined. According to 
Theorem 2.2.1 this test possesses the Structure of an MP-test. We 
stop sampling and decide for H, if La EN e is sufficiently large, 


which is an indication that probably Knot ents H, is true. Other- 


wise, we stop sampling and decide for H if = 
Ki "n,8,8, = O because 
then it will be evident that e is true, 
We remark that 
lim L = OO 
n > 9 el 


if H, 1S true so that bound a is always Overcrossed if H, is true. 
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Moreover, it is evident that Po (N< 00) = 1 holds. 
o 


In order to determine the quantities Ce and Ze to given &, O< < 1, 


we consider the distribution of LN, J o: without any lose of genera- 
1 
lity we may EuPL See that an integer n “21 exists, where 


(€ /8,)" = a. 


Then Ly o og takes on only the two values O and a, and we have 
$ oi 1 


Also, n 
Po (L = a) = Py ( x, OW} ) = (0478,) 
a S N.O 8, ri a 1/ "o 
and 

(L =0)=1 - roue um 

Ba N,8 8, 1’ 7o 

We distinguish between the following three cases: 


with probability & if 


(i) Po (Cy 9 9.7 a) =o: Then we accept H. 
o "e" 


1 
H_ is true iff 
o 
O<cy<a and You 0. 
Moreover, we have Me, )=E 0,9 X {N < e0} = 1. That means we accept H, 


with probability one if H, is true. Hence, test (N, ó ) is a so-called 
power one test at level e, which is an MP-test obviously. 


(ii) Po (Ly o .9. * aler Then, the acceptance of H, is not suffi- 
o "oi 1 


1 
cient only in case of Ly g o to reach significance level o. There- 
"e"? 


Tore, we have also to accept H, with a certain probability if Lue e 
: D o 8 1 


a 0. Hence, we choose c,= O and obtain 


A 
X= MI Is P, (L >0) +¥eP, (L = 0) 
o N18, 84 9, N,8,0, 


n* w 
= (8,/8,) + yalı - (8,/8,)" ) 
iff 


n* n* 
Yan (X - (0,/0,)" 9/01 - (0,/0,)" ). 
Again ON. di is a power one test. 
(iii) Po (ue a, = a)>xX: Here we have to reject H, with a certain 
probability, even in case of Lye 9, = a to reach significance le- 


velo. Thus, we choose cy = a and obtain 


o= MO) = Po (L >a) +YxPa (L = a) 
o 0. N,8,.8, Ve die EE 


= 0 + 2u(0,/0,)" 


a 
Yas %/(0,/0,)" . 


iff 
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Then, we only have OCH = Ya This case shows that to a given sap. 


ple size the requirement for the implementation of a 


given significan 
ce leyel ` 


may be invalid because a formal implementation of the Jiven 
Significance level may lead to obviously false decisions P 


If the parameter space O consists of more than two parameters, the 
assertion of Theorem 2.2.1 can be extended as follows. 


Corollar Y 2.2.1. Let (N, $) be an MP-test for H:0=0 


o 
against H: @ = 0, at level e according to Theorem 2.2.1 with the 
Power function M(Q). Let (N,d ) be any other test for these hypothe. 
Ses with power function WOCHE 


(i) Let@' and Ei: be non-empty subsets of @ defined by 


CN {0'E Q: There exists a ge with (0',0") A CB )} 
and h>o ee 
SR (2.118) 


Ch e {e"€@: (8',0") A (6, .8,), geet, (2.119) 

M()>M(@) for oe @ implies M(8)2M(9) for 9€@", (2.120) 
EN 

(ii) Let e and & be subsets of ® defined by 


6 - (äee, There exists a @€ © with (3,5) A (8, .0,)} 
and h20 
D (2.122) 


©- (6€@: (6,8) 8 (0 ei de). (2.123) 


Then 


Then x 
M(@)<M(@) for OEM implies M(@)€ M(@) for oe Ô. (2.124) 


Proof. First, we remark that because of (0594) KL (95:91) the 


introduced sets @', O", 6) and are non-empty sets. Further, 
it has been shown in the proof of Theorem 2.2.1, cf. (2.111), that 
“a - 
(ó -óo 9 - cy)>0 on NUN, (2.125) 
$ o’ 1 


where IL and Q” are defined by (2.107) and (2.108 
Then, (2.125) implies 


), respectively. 


Fei A "Dit es, u en X {N< o0} > 0 (2.126) 
and n 5 
Eg(d 7 d CHE = Bet dd < po} É 0 (2.127) 


for h>O and ee Ia. 


(i) For any given ger: let 9'E@ be the corresponding gie: 
with (@',0") n (8584) and h>O. Then, by (2.126) and Lemma 1.6.1 
we obtain 


Ey. (ô e BECH 


h 
OCH Ca de {N< 00} 
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A h h T 
= Eg (6 -é two, 0% use - cy Eg (8 -ó X {N< oo} 


= Se (A - ó)X Ly coo} ` SCHEER X {N< och 
>0. (2.128) 
since M(@')>M(@') for @'€@", this implies M(9") >M(O") for ger, 


(ii) Assertion (2.124) is e®@tablished analogously by means of 


(2.127). E 

The property of an MP-test characterized by this corollary can be 
interpreted as a restricted uniformly most powerful property. On 
condition that this corollary holds every uniform reduction of the 
probability of acceptance of H. for @ €@' by applying a terminal 


decision rule é which differs from $ effects a uniform reduction of 
Conversely, a corresponding uniform 


this probability for 9Ee@"-. 
effects a uniform in- 


improvement of the power function for gt 
crease of the power function for O€ ‘ 
We consider the following example. 

(N,6) be an MP-test for H. H = 9, against 


Example 2.2.2. Let 
according to Theorem 2.2.1 based on a se- 


Hr O = Bu, Hz Ba" Bu" Et 
quence (X Iner * Of Leif, 

fo(x) = h(x) exp(d(@)t(x) - c(@)), 
Suppose that Lemma 1.6.4 holde. Let 9° be the separating-parameter 
given by (1.58). Then, by Lem@e 1.6.4 to each 9'< 0" a 0"> eo" corres- 


random variables having density 


xEX , 9€(8,9). 


ponds so that 
e(o',0*) -5(0",0"). (2.129) 

This correspondence is a one-to-one correspondence between the ele- 

ments of (0,0") end the elements of (0*,0). Applying Lemma 1.6.5, 


we obtain 
h a d(@") - d(@ bso 


(0',0") © (@,,0,) with 
d(@,) - 4(@,) 


for every pair @',e" € (0,0) which satisfies (2.129). Then a possible 
choice for @' is @' = (8,0*), and we obtain 
@- = {re (9,0): (@',0")  (0,,0,), O'E (8,0")}= (0*,8). 
We remark that a possible choice of sets e and Â considered in the 
second part of Corollary 2.2.1 is again 
k ges 
® = (8.0) and Oe (0",6). 


This can be shown analogously. 
If now (N, 5) is a further test for H,:0 = 0, against H: 6 = H, with 
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M(@)<¢M(@) for @€(0,0%)v<o"s, (2.130) 
then Corollary 2.2.1 also implies 

M(@)SM(@) for @€(0%,0). 
Hence, already (2.130) ensures here that M(@) is not greater than 
M(@) for every @€ (9,0). For special examples satisfying the above 
assumptions we refer to the distributions considered in Example 
1.6.1.0 
We present a further consequence of Theorem 2.2.1 and Corollary 2,2,1, 


AN 
Corollary 2.2.2. Let (N, 5) be an MP-test for H,:9 = 9, 


against N,: O = Hu at erh ol according to Theorem 2.2.1 with power 
function M(@). If "re: er) a (O 04) with h>O then (N, 6) is also 


an MP-test for 


D = r m UI 
H. € € against H,: © 8 


at level M(@"). 
Let (N, ) be any other test for hypothesis H. 


with power function M(@), where M(®' (e Ao" Je 
(2.128), 


Proof. : 9 = 9 


against H4: O = 8, 
Then, for (@°,e" A KC with h>O we obtain, cf. 


h 
Eg. (8 - 5) (ty, 9.0, T Se IN eo} 


A h A 
= Egn(5 - FX dy cacy ` Co Egh S -6 Ed yea) 2 
Hence, M(@')< M(e') implies M(@")< OM so that (N, 6) is an MP- 
test for Ho? H = @' against H4: 8 = O” at level Mo'). W 


Based on this corollary we additionally obtain the following proper- 


ty of an MP-test, which can be interpreted as a certain locally 


most powerful property. 
2.2.1 Let (N,6) be an MP-test according to Theorem 2.2.1 


Lemma 
Let (N,4) be any other test with power 


with power function M(Q). 
function M(8) where 
m(o*) = M(e*) 
E A 
for any given of, gege O. Suppose that Ba and M are differentiable 
contains a pair 0',0" E 


(2.131) 


at @ = 8”. If every EE of of 
(0,6), ge 0*< 0", so that (0',0") e OCH ‚8 1) with h>0, then we have 
= A 
gm(e)) „mie (2.132) 
de 9=0* de Gap 
P roo f. We assume dite) < dM(Q ) (2.133) 
do geg P de log 
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R 
Since (2.131) and D and M are differentiable at 8 = ® for each €> 0 


* e 
an €-neighbourhood Ue (9? of Q” exists so that 


m(e)<M(@) for @€ Ug(@™) and geg (2.134) 


d 
a M(8)> M(6) for ge Us(9") and 9"<®. (2.135) 


By assumption there exists a pair 9',0"E UE(O*) with @'< H < 0", 
(9',e") © (Ə _,0,) and h>O. Then (2.134) and (2.135) imply 

M(@')< M(e') 
and 

M(@")> M(@"). (2.136) 
Otherwise, because of (8',0") o ICH ‚9 1) with h>O we may apply 
Corollary 2.2.2. According to this SCENE test (N, S) is also an 
MP-test for H : @ = H against H,: O = O" at level M(o' ). This im- 
plies M(9")< M(@"), which contradicts (2.136). Hence, assumption 
(2.133) is false and we have (2.132). W 


This lemma describes a further optimality property of the MP-test 
(N, 6). Within the class of all tests at sample size N satisfying 
Lemma 2.2.1 there does not exist a test whose power function at © 
= 8* possesses a larger slope than the power function of the MP-test 
(N, f j: This property may = of importance if instead of 95 and 0, 
the separating-parameter e* is given and we are interested in a test 
for hypothesis 

H. oso” against H: SEIN 
In this context we again refer to Sections 2.1.3 and 2.1.4 
Conditions on the differentiability of the power function at 8 = 9* 
have been considered by ABRAHAM [1] and BERK [13] for tests (N, 5) 
based on a sequence XJnert of i.i.d. random variables having a 
density fo(x) w.r.t. some measure M. These differentiability condi- 
tions are fulfilled for the subsequent example. 


Example 2.2.3. Let (N,&) be the MP-test considered in Example 


2.2.2. We will show that every €-neighbourhood of O~“ contains a pair 

0" € (8 0) satisfying the assumptions of Lemma 2.2.1. In doing this 
we consider function 9(6, eg" ) introduced by Lemma 1.6.4. To given € ?O 
let Se be defined by 


er- min {g (0*-€ ,0*), Eier ‚o*r)},ir 9<9*-£ or o"+e<5, 
r- 


Then, the vono onee ty properties of S(e, or) in ©, Ste, 9” )#O for 
SEENEN and >18, 9*) possesses a uniquely determined minimum at 
© = 8” imply > 0. Hence, f 

Ge ‚ tor every So’ O< e St there exists 


> ‚ otherwise. 
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a pair 9',0” e (9,0) with 
x 
6(9',e*) = §(e".e )70 h p 
Applying Lemma 1.6.5 we have (@ MEA) where 


h>O is determined by (1.65). As shown by [al and [13]. the regula. 
rentiability of the power function 


rity conditions ensuring the diffe : 8 
at 9 = O* are fulfilled for the distribution family considered herg, 
Thus, Lemma 2.2.1 can be applied and the poner Gegen of test 

(N, 8) possesses the largest slope at @ = 8” among all power func- 


tions of tests satisfying Lemma 2.2. 1.8 


and Biz geg, 


2.3 Unbiased tests 


: 0 = 6, against H,: H = ©, then it is 


to tests which accept H,: 


If (N, ó) is a test for H, 
1 


reasonable to restrict ur trent on only 
Ə = @, or H,:09 = @, , respectively, at least as SO often as the 
Geet is true rather than it is false. In terms 


corresponding hyp 
respectively, that means 


of the power function or the OC-function, 


that for the tests in consideration 

Hegle M(@,) (2.137) 
and 

0(8,)>.0(0,) (2.138) 
should be fulfilled. 
2.3.1. We shall say, the power function or the 
: @ = 9, against H4: O = 8, satis- 
respectively, 


Definition 
OC-function of a test IN, Al for H, 
fies the unbiasedness criterion iff (2.137) or (2.138), 
holds. If (2.137) and (2.138) hold simultaneously, the (N, ó) is 


said to be an unbiased test for H. O = 8, against H,: Q a df 


The following lemma presents two inequalities concerning the OC- and 
power function of an MP-test according to Theorem 2.2.1. These in- 
equalities can be used to obtain assertions on the unbiasedness of 
MP-tests. 


AN 

Lemma 2.3.1. Let (N, Al be an MP-test for H,: @ = @ against 
H,:0=8, according to mere 2.2.1 with power KEE M(@) and 
OC-function 0(8). If (@',8") Are, ‚8 1) with h>O, then 

wariee wë? (2.139) 
and h 

o(0")<c Qe"). (2.140) 
The first strict inequality holds if Pa (na 0,7 Se N<0o)7 0, 


the second one if Po-(In,o_ ‚e,< Cy, N< eizo, 


For an MP-test (N, $ ) according to Theorem 2.2.1 we have 


Proof. 
is accepted}. 


Ly, e, ,0, © cy on An. is accepted} and Ly, o. 0,7 C< on An, 
en, this lemma is a conclusion of Thid an 2.1.1. W 


We discuss some consequences of this lemma. 


(i) Conjugacy and unbiasedness: Let (N, 3 ) be an MP-test for ët ei 


= 8, against H,: Ə = 98, according to Theorem 2.2.1, where (9° e“ Käl 
(9, o 1) with h?0. Then Corollary 2.2.2 implies that this test is 
effet en MP-test for Ho: @ = H against H,: 8 = 8" at level M(®'). 
If c«21, then (2.139) implies 

M(8')<s M(9”), 
and the power function of (N, d) satisfies the unbiasedness criterion 
for 8, = 9° and eo, = 9”. If cy¢1, then (2.140) implies 

0(9')> Q(e"), a 
and the OC-function of (N, 4) satisfies the unbiasedness criterion 
for @, = Dei and @, = 09”. Putting this together, then cy = 1 and 
(ër et A (9,,9,) with h>O imply that test (N, S ) is an unbiased 
MP-test er Ho : @ = O' against Hy: ° e 9°. Especially, because of 
(9 5194) 0 (8, OR every MP-test (N, 8) for H? @ = H. against H. 


O = O, with c„= 1 ie unbiased. 


1 
(ii) Bounds for Gei If 


Q(@')>O and Mm(@')>O0, (2.141) 
then it followe from (2.139) and (2.140) 

Q(@")/Q(0') € ele M(@")/M(0" ) (2.142) 
for (0',0”) WV (9,9, ) with h> 0. Particularly, for @' = H. and 9" 
= @, we obtain 

Q(9,)/0(9,)e oye M(@,)/M(@,). (2.143) 
If additionally M(®) = & and HS, = 1 - B then we have 

B/(1 -x )€ og (1 - B)/&. (2.144) 
(iii) Closedness and unbiasedness: Let (N, 8) be a closed MP-test 


for N: H = 8, against Hy: O = 9, where (2.141) and (9',0”) A (9, Bal 


with h>O holds. Then, instead of (2.142), we obtain 
(1 - M(O"))/(1 - MT M(8")/M(@'). 


That implies 
M(@') € M(0"). 

Since M(®) + Q(@) = 1 for a closed test, we also have 
Q(e')»Q(e”) 
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A è H 
so that test (N,d) is an unbiased MP-test for H,: © = H against 


H. © = ©" at level M(®'). 


(iv) The unbiasedness of LRTe: Let (N,d) = Vo 9.9 "En Annen+ 


be a LRT for H: @ = @, against H,: @ = @,. Then 6 is defined by 


(2.2). If we may suppose that 

sup B <1<inf A (2.14 

ner* "N ner* n 5) 
then terminal decision rule 6 can also be written as 

§ =X i 

Vue 0,2 1 del 
oi 1 

Hence, if (2.145) holds, then by Theorem 2.2.1 the above LRT is an 


MP-tes : e H = © t level = E ji 
t for Ha: 2 H. againet H,: © 1 2 o IKK cas} 
d 


withc« = 1 and Wes 1.This implies, as already stated in (i), that 
this test is also an unbiased test for H. O = H. against H. 9 = Ba 
Therefore, every WLRT (N,6) = {tn,0,,0, Dr tner* for Ho: 5 
against H. H = 8, with O<B<1<A< co is an unbiased MP-LRT for 
Hj: @ = @, against H}: © = @, at level A = Eg IX {nc oo} with cy = 1 


°° 
and Zei = For the hypotheses H. H = 0' nn: H4: H = 0” an ana- 


logous assertion can be obtained "ir Mik wu (8, ‚8 4) with h>o. 8 
Moreover, the following assertion holds for LRTs. 


Theorem 2.3.1. Let (N, $) = Aln,o DR ‚B nAntnept be an LRT 
Then, every nef*, we have 


(2.146) 


for Ho: 6 = 8 against H,: O = ef 
OI )2 Q.(9,) and M,(9,) € M(84)> 
where 
Q (9) = Eg X 
n e" {Luo 0, S Buchen) 
o’ 1 
1 
In particular, (N, di is an unbiased LRT. 


n 9 {no ,0 >A NE n} 


Pr oo f. The assertion of this theorem can be obtained by mathe- 
matical induction. For the sake of abbreviation, we shall write L, 


for nert here. 


instead of ËCH 
h 
Since (8,,8,) u (8581) we obtain 


1 
(i) We verify (2.146) forn = 1: 


M(8,) = Eg X {L 2A,,n = 1) 


SA, Ep L4% 
1 "o "CTS A, eil 
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-1 
al Eo, *{ L1? Ay ‚N=1) 


H 


ATIM, (04) 
Pr G for A, ?1 
o e 
by Lemma 1.6.1 for A,r1. This implies M,(9,) € My ( 4) 1 
If A,< 1 holds, we consider 


Q,(9,) a Eg *ÄL, <A, Nal 


-1 
vr Cd ke A, Ned} 


-1 
E 
Ag 0,*{1,< A, Weil 


u 
> 


and we obtain 

q, (6 ,) > 4 (84) for A,<1. (2.147) 
By definition of Q,(@) we have Q,(e) + M,(@) = 1 for o e ®©. There- 
fore, (2.147) implies WIDE M,(8,) also for A,< 1. Hence,we ob- 
tain M, (8,) € M1(81). In an analogous manner we can verify Q,(9,)2 
0,(8,)- 
(ii) We suppose (2.146) to be true for any nef": Then, for A n41 1 
we have 


M,.,(0)=M (0) + EQ X 
n+1‘~o n` o S- {L 1? Ang Nene1} 


-1 
€ M(8,) + A_ 
nl 1) n+1 "o. "wei KL AA An ,j.Nen+1} 
-1 
= M DCH + A 
) n+1 Ce “4 Lal? Anyy.Nan+1Y 


IN 


WICH E de dä WER 


nea Nened E 


Mn+1(91)- 


If bai?) holds, we consider 


O 


(9) = Q ol BA ) + Eg X 
+1 
° ` di Leis Any Nenet} 


WwW 


Q,(8,) + AW x 
a 
n+1 04 Abari A Any .Nan+1} 
CHE 
n+1 
2.1 
We again have CH (8) + M,7(9 | " 
+1 4169) = 1 for get, From this by means 


of (2, 148) we sbtaan M 


(e. LSM 
similar manner we Si ee n+1(9,) also for A 


<1, and 
ow that n+1 nS In @ 
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Po 1 (95) > O44 (94) 
Thus (2.146) holds also for n+1. Finally, because of (2.146), 
= = = u M (2) 
Hie EQS X (yc 00} ltn Pe Xing yn} n(®) 


and 


Q(@) = Pei) - 8X fn coo} = lim Q,(@) 


n+ CoO 


we obtain CH KEANCH ) and Q(e en so that (N, ) is unbiased, E 


We notice that in case of (0',0") ~ VEC ‚8,) with h>O test (N, éi 
considered in SE theorem is also a Unis sea test for d : @ = Q' 
against H. @ = 0" 

2.4 Admissible tests 


Let (N, ó) be a test for H. : Se), against H,: oe Oj ©, 0,0, 
© 910, = Ø. Then a eege property of this test is that its 
power Ge M(8), BE ®©), should be high for values of gei, and 
low for values of gen. . In order to specify this DEE we 
consider so-called adniesible tests. 


Definition 2.4.1. A test (N,6) for H: 8E®, against 


At gem, ©, D, E OMO) 319, = Ø, is said to be an admissible 
test at size Ge ei if to any given & and B, O<X,B <1, X+ Bei, 


M(O)€ «x for BE O, (2.149) 
M(Q)21-B8 for o c0. (2.150) 


and 


Assertions concerning the admissibility of a test (N, ô) require 
certain structural assumptions. In the sequel we investigate how to 


choose the stopping bounds B and A of WLRT (N,d) = Ia. ,e, P Aner 


to obtain an admissible test at size (e Bi, Based on two-sided 
bounds for the conditional expectation values introduced by Theorem 
2.1.1 we shall obtain two-sided bounds for the true risks of our 
WLRT. These bounds can be used to obtain values for the stopping 
bounds B and A such that to given & and B test (N,d) = {L 


CRT 

$ o’ 1 

BA] opt is an admissible test for Tat 9 = 0, against H,: © = @,. 
Lemma 2.4.1. Let (N,ó ) "Alan, ,o,BAner* be a closed WLRT. 


d ACHEN (8 ,,8,) with h>o, 
h 8 UI 
Ge (Ae, oP CH oo} |H, is accepted) > B v_(9',0") (2.151) 


and 
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"erltwe ‚e,*4ncoy|Hı is accepted ) < WI) ‚9"), (2.152) 


then the true risks &(6') and B(e") satisfy 


_ h 1- dk h 
——+— 4, en CHE SE (2.153) 
MI e" )A = B A = v(0',0")B 
and bh. bh 
(er,o")B(aA" - 4 eh „erja? - 4 
> < B(0") € Ee A (2.154) 


A - ¥,(0',0")B v (0',9")A" - B 


Proof. For the sake of abbreviation, we shall write v and Vv, 
instead of v(e',e”) and KINN respectively. Since (N, ) is 
closed, by Theorem 2.1.1, the definition of the true risks &(0') 
and B(0”), (2.151) and (2.152) we obtain 


vB" € B(0")/(1 - ie < BO 


(2.155) 
and h h 
A SO - B(O"))/x(0") $ mA", (2.156) 
where oey € 1< Y,. From (2.155) we obtain the inequalities 
i ß(0”) 
A(0') + S 1 (2.157) 
vB i 
and S 
o (0') + ie”) € 1. (2.158) 
B 


From (2.156) we obtain 


ote) + ene? (2.159) 


1/A 


SLL B(o") 21. (2.160) 


1/9, A 


and 


Fig. 4.2.1 illustrates inequalities (2.157) to (2.160). If a point 
(&(0'),B(0")) satisfies these inequalities, it must belong to the 
shaded quatriliteral given by points S}, S 


>! S3 and ft These points 
have the following coordinates: 


S, = ((1 - Bryan - BT), Ban - ot - ei 


h h h h,,h h h 
S, = ((1 vB LIA - v8 : (7,8 (A - 1)/(A - vB )) 


Sz = ((1 


h h h h h h h 
ZB ZNA - VOB). YB (IA - 1)/(vA - v.B)) 
h h 
S4 = ((1 - Bitze - BM), Ba - 1)/(v,A" - BI. 
Hence, rieke (girl ranges between the abscissa of S, and the abscissa 
of S,, risk 8(@") ranges between the ordinates of S, and S,. B 
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B(E") 


x(68') 


Fig. 4.2.1 Graphical representation of inequalities 
(2.167) to (2.160) 


By means of inequalities (2.153) and (2.154) we obtain the following 
admissibility criterion for WLRTs. 


Lemma 2.4.2. Let (N,d) tee, D Inen* be a closed WLRT 
where 

Eg (ag, ,0,X (N<eo} | H5 is accepted ) 2 B% (0:94) (2.161) 
and 


< 
Eo Tina, 04X {N <oo\ | H, is accepted ) S AV, (9 94). (2.162) 


Then (N, 6) is an admissible test for dë 6 = 8, against H4: 8 = 9, 
at size (œ ,8) if the stopping bounds B and A satisfy 
1 
A> Z (1 - (1- æ ) v (05:891): B) (2.163) 
and 
B< 8 (1 + 1-8 Je (2.164) 


KICHEN: +B- 1 


w (9, 04) it follows from (2.153) and 


proof. Since CRT 
n admissible test 


(2.154) that test (N,d) = De e ner" is a 


for Ho’ Ə = 8, against H,: 9 = 9, at size (X ,ß) if 
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xX (8) E(1 - dE V (89, 91)B) E€ < (2.165) 
and 


B(0,) < B(A (8, 94)A - 1)/(¥,(0,,0,)A - B)E B. (2.165') 


The right-hand sides of these inequalities immediately provide 
(2.163) and (2.164). W 


Since 0<vV,(9,.8,)¢ 1 £ (85:91) it follows from (2.163) and (2.164) 
that under the conditions of this lemma WLRT 


1 
(N, 6 ) {hae .0,°% Z )ner* (2.166) 


is always an admissible test for Ho? 9 = O, against H,: @ = Hu at 
size (%,8). More precisely, the following assertion holds. 


Corollary 2.4.1. Under the conditions of Lemma 2.4.2 the 
smallest value A, for A and the largest value B, for B so that 
(2.162) and (2.163) hold are given by 


Ga + Cc. = ChB 
TE ees (2.167) 
o 
2 
and 
A, 
BL = 8 ` (2.168) 
A -c 
o 3 
where C41 Cy and Ca are determined by 
1 1 -œ 1-8 
Cc, ma Ga = —— Y (0_,90,) and GA = «(2.169) 
1 & 2 of D oi 3 
”,(8,.8,) 


Proof, As shown in the proof of Lemma 2.4.2, the considered test 


is admissible at size (œ BI if (2.165) and (2.165') hold. From 
(2.165) follows 
BR + —8B_ > i, (2.170) 
Lie  1/(1-%&) 
from (2.165') follows 
A 
BER (2.171) 


A - (1-B)/¥, 


In an (A,B)-coordinate system equation (2.171) describes a hyperbola 
whose asymptotes are given by the equations 


A = (1 - dad and B= B, 


Since OsV Leg, and O<&,B<1 it can be shown that the straight 
line given by (2.170) and the hyperbola given by (2.171) have one 
and only one common point for O<B<1 and 1<A< eo, This is illustrated 
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in Fig. 4.2.2. Hence, test (N,4) = {In,o_,o,?’Alner* is admisit 
le if point (B,A) satisfies inequalities (2.170) and (2.171), and 
this is fulfilled, if point (B,A) belongs to the shaded region of 
Fig. 4.2.2. By (2.169) we obtain 
A e C, - c.B 
and 1 2 

B a BA/(A - Gel (2.172) 
for the equations (2.170) and (1.171). This provides the quadratic 


equation 
a? + (c38 - Cy - Cz)JA + Gufs = 0. 


For 1<A< 00 we obtain solution (2.167), and, together with (2.172) 


we obtain (2.168). W 


IN | (A, BS) 


(SS) 


d (1-B)/r, 1 


Fig. 4.2.2. Graphical representation of inequalities 
(2.170) and (2.171) 


As already stated above, test (2.166) is an admissible test. This 
also follows from the above corollary if we put (9,9) = O and 


V (9, +84) = +00, 
For some cases - compare the examples at the end of this section 
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it will be easier to compute $ (8,9, ) than (9,:97)- If in such 
case's we put (8,94) = co, then we obtain 


end. (2 06) PN (0g 183? 


dë 
e = "effi? = (2.173) 


x 
o 
sn 7 (2.174) 
o 
by (2.167) and (2.168). If we choose the stopping bounds in such a 
manner, then Sen may already be al essential improvement in compa- 
rison with A = AT "ew L/e and B = BD’. B, 
Now we consider a method for determining quantities v (9' .8") and 
vy(e' 8") introduced by Lemma 2.4.1. 


Lemma 2.4.3. Let (N,6) = {on ,o_.e,'P’Alner* be a closed 


WLRT with n 
+ 
In "n,8,,8, = > ner 9 
i=1 
where {YJ ert are i.i.d. random variables. If (0°,0") db (9, .8,) 


with h>O, then (2.151) and (2.152) holds for 
1 Pu (L DEA 

v (0',0") = Ant e EE (2.175) 
<5 $15 Polli 9:97 £5) 


v (0',0") = a Po-(tı 91,07 >5) , (2.176) 
z 1986005 Po (L4 gs gn 23) 


and 


Proof. Let Zy be defined by Zy ” ln LNO 04" Then we obtain 


h 
B= Ea: (ue, ,0,% {ne co} De is accepted ) 
= Eu.(exp(hZ,) | z, € In B) 


= Ey. (exp(hZ,_, + hY,) | Yng 1n B - Zu_4)- 


for 8', then 


Denote by Fz (z) the distribution function of Z 
N-1 N-1 


because of In B<Z,_ ,< In A we obtain 


a 
J Eg.(exp(hZy_4 + hY¥y| YNE IN B - Zu 1 Zu 


wee ie 


g J exp(hz)EQ.(exp(hY,| Yy£ ln B - z.z 


IRMA Jl: 


The eler are assumed to be i.i.d. random variables. This im- 
plies 


Ee, (espihtivil YyE 1N B - Z.Zy-1 = z) 


> Eg. (exp(hY,)| Yy “in B - z,2,_7"2.Nen)Po.(N = n) 
ner" 


= > Ee, (exp(hY, ) | VW In B - Z,Z,_472.N=2n)P,.(N=n) 
net" 


= > Eo. (exp(hy,) | VW In B - z,Nan)P,.(N = n) 
ner" 


= > Be, (exp(hY, ) | VE ln B - Zeen Po, (N =n) 
ner" 


a Eg. (exp(hY,) | Lg ln B - z), 


and by h>O we obtain 
E 


B = hz)E,. hY,)| Y,<1n B - z)dF 
8 eg zJEg.(exp(hY,)| ra sin B - z)dFZ (2) 
a 
= f exp(hz)Eg.(exp(hY,) | exp(hY,) < exp(h(1n B - z)))dF, (z). 
b N-1 
We substitute 


Es exp(h(ln B - z)) for O<z< œ, 


Then In B<z<1inA is equivalent to 1>5 > exp(h(ln B - In A))>O, 
and we obtain 


> -1 ins 
B= f exp(hb)e*eg.(exp(hY,) | exp(hY,)s@)dF, (1nB - >) 
£ =0 N-1 


-1 
2 exp(hb) oe en E Eg: (exp(hy, ) | exp(hY, )<)-1 


= B” inf @ tEn. (L 


0<&s1 


h h 

L s2) 
1,0,,0,! ‘1,0 as 5 
h 


= B” inf Sie 


ett 
o<eei? P 


1 6: gr | LA e er <5) 
{L f Ly HI EK? 
' wë 
za: int et 1,0',9" 55 § 
e ES 
o<§s1 Po (Li gr ge SS) 


86 


La Panik en | 
et ane CHA a on 5 


SËCH Pe, lues ‚gr 5) 
so that (2.151) holds, where (0',0") ie determined by (1.175). 
Analogously, we can show that (2.152) holds if v,(0',9") is given 
by (2.176). W 
This lemma, for instance, can be applied if (N, ó) -ÄL, g o BAS ert 
"oi 1 


is a WLRT based on a sequence (Duett of 1.1.d. random 
variables having density Tell, oc bh. xc%X . Then we have 


n 
= In(f X, )/f x 
2, 2 Co, (pute Da 
and 


+ 
Ya = nt fo, (Xh) fo (Dall, ner. 
o 
If, moreover, the distribution of X, belongs to a one-parametric 


exponential family, quantities y, (8'.9”) and v,(0',9”) can be deter- 


mined as follows. 
Lemma 2.4.4. Let (N, 6) = (ee, Anert be a closed WLRT 
based on a sequence {x Iner* of i.i.d. random variables having 
density 

fo(x) = h(x) exp(d(@)-x - ¢(@)), xe ¥ , CEM. (2.177) 
Suppose that d is strictly monotonically increasing in © on ©. If 
o: gr and (8',0") d (95.91) with h> 0, then we obtain 
Por (Xas $) | 
Pe, (X45 EI 

(2.178) 
"E, 
Pgs (X> ¥) 
with (2.179) 
k 
E = (c(94) - c(9,))/(d(84) =- 4(0,))- (2.180) 


+ (0',90") = exp(e(@")-e(0")) ant Mësgt 29" )-dte dp 


+,(0',0") = a vi (exp -(d(0")-d(0"))F) 


Proof. We substitute variable § of (1.175) by 


B= Zeite = exp((d(or) - de - (eier) "stéi, 


By (0',0") ta ,0,) with h>0, @'< 9”, (2.177) and d ie strictly 
monotonically increasing we obtain 


Por(ly ge gS) = Po (X, € Ei, (2.182) 


Furthermore, inequality 
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o<5 <1 
of (2.175) is equivalent to 

- co< F<(c(0") - ep yc dca") - de’). 
By Lemma 1.6.3, (1.31) and (1.32) this inequality is furthermore 
equivalent to m w 

- eo < Feieiëul - e(85 ))/(d(8,) -~ d(@,)) $. (2, 184) 


(2. 175), (2. 181), (2. 182) and the equiy,. 


Then (2.178) follows from 
cence of (2.183) and (2.184). Analogously, we obtain (2.179), m 


is strictly monotonically decreasing in @ on D, then, 


We note, if d 
178) and (2.179), we obtain 


instead of (2. 
Po. ob, 
PaO 


TER "1.c(0' inf {exp(-(d(")-d(8"))¥) 
¥,(@',8") = exp(c(®") c(@ (eil, be f dër 
and (2.185) 
*,(9',e" @")-c(@')) sup { exp(-(d(0")-d(@" pad) 
*,(9',0") = exp(c( Er DE 
(2.186) 


Moreover, we remark that variable E used in Lemma 2.4.4 is 
continuous variable, even if the random variables {X nert are dig. 
crete. If we have a sequence of integer-valued random variables, 


then Lemma 2.4.4 can be modified as follows. 


Corollary 2.4.2. Suppose that Lemma 2.4.3 holds. If XST, 


taen Po (Xe E*) (eil Pan (X, £ x) 
y,(8',9") = er re es ra 
Pe, (X48 E) nex SÉ: fgn(x+1) Be, (ug x) 


and 


P(X g E. (xe ` 
v (8' ‚e”) = [ee su (ee (2.188) 


Pa. (X42 §" xe p 

gr (X12 $ ) xc% Led for (x-1) Py. (X,? x) 
where fis determined by (2.180). 

Proof, This corollary immediately follows from Lemma 2.4.3.0 


with respect to possible applications, the following special casé 
may be of particular interest. 


+ 
Corollary 2.4.3. Suppose that Lemma 2.4.4 holds. TEE 


oe and 0< ¥*<1, then 


v(8',0") = exp(-(c(8") - c(o')), (2.189) 


A 
Proof.ByO<f<1,0€E% and (2.178) we obtain 
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au ` „Por (% F O) 
(@ BI = exp(c(® )-c(@")-(d(e")-d(@") )§ P(X, = OY e 
By Lemma 1.6.3, (2.180) and (2.177) we obtain 


exp(c(9”)-c(@')-(d(@"”)-d(@"))E*) = 1 and P,(X,=0) = h(O)exp(-c(®)). 
This, together with (2.190), implies (2.189). W 


Example 2.4.1. We consider the computation of KEN and 
v(e',0") for some special cases of (2.177). We refer in this con- 
text also to Examples 1.6.1 and 2.1.0. 


(i) The binomial proportion. We suppose 0<8,< 8,< 1, then by (2.180) 
we obtain 


1-8 9,(1-8) 
E: In déi nt, | ER oef ` 1. 
1-0, 9.(1-8,) 


Applying Corollary 2.4.3 we obtain 


h 
1 


a 1-9" 1-0 
¥,(@',0") = —— = ( 


1-9" 1-0 
o 


In order to obtain »(0',.0"), we notice that 
”* 
+ 
Po(X, > $ )s Po(X, 28") m Po(X, = 1) = H for Le . 
Then, by (2.188) we obtain 


H rm - U h 
vy (0',0"”) = 0"/0' = (9,/8,) - 


(11) The Poisson mean. We obtain 
A 
Er. (0, - 0,)/1n(04/8,) - 
H 
If we may suppose that 0<@,< 8,< 1, then we have o< < 1, 
Applying Corollary 2.4.5 we obtain 
¥, (9° 8") ew exp(@' - 0") = exp(h(®_ - 9,))- 


By (2.188) we obtain 


Lin SS en Sc LR ck a 2 xX) 
Ken 1-0”0 CHEM A we Wie Ae) } 

¥,(@°,0") = =r = 

1 ( ) nax| ie ° Een RT) 


(iii) The normal mean. We consider WLRT for mean O with hypotheses 


H. H = -9, and Hy: 0 = 8, 


end assume that 5? = i. Then we have d(O) = O and c(®) = 0° ,/2. 
This implies t= O. We start with KIK) RI and remark that here 
(8,0) ( -94:8 ) with h>o implies O' = RI and 0" = he,. Then, 
by (2.179) we obtain 


CHE MET ¥,(-0",8") d Da a al DIRT D) 


8,7 0, 
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Let Yyı be defined by GC exp(-20" ¥) for > O. Then Vu 18 a decrea- 
Bing function in E. Let y, be defined by r 


= p(o" Tipi Di, Plz) dk expl -2°/2) dz. 


Then we have e”- 
Y> dëi d'r set di f(z) = a exp(-z°/2), 
end we obtain 
ys Lief #99 (-0"-F)p(0"-F) )/(a(-9"-¥))° 
e (eier + P(-0"-F) 1)7(9(-0"-F))* 
so for Fro 


for the first derivative of Yo Wert. £ Hence, also Y, is a decrea- 
sing function in f on E 20. This implies 
2(0") Hië ) 
2(-0") IR -he a 

For ¥ (9° 8") we obtain 


v (6' 0") = ¥(-0",0") = pe 


+ (0' WW 


exp(-20" A EE 


We substitute f= -. and obtain with - 8" = @'< O 

or“ ee ën - 
where exp(-20%) and Ø(-ù + 9')/2(-n - 9') are Wé functions 
iny. Then we have 

CHEN , 2(9') . 2(-8") . EACH oui? 

a(-e') Ce") 
The assumption 5? = 1 and the symmetrical choice of the hypotheses 
are no restriction. If, for instance, we have a sequence {x Vert 
of independent N(6,6°)-distributed random variables with known 


variance 67>0 and if we want to test hypothesis 


H:@=0 against H,: ô =ô °<9 (2.191) 
o’ re) 1’ 1?’ o 4° — è ~ 
then we can always use the following transformations: 
A A 
Qo +0 
x dÉ - Ale for nen, (2.192) 
n n 2 


6 +ô 
Q = (6 ape ia de (2.193) 
2 


Then, the random variables {x3 ert are independent N(9,1)-distri- 
buted random variables and hypotheses (2.191) are equivalent to 
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H:9 = - 8, =- 1 o A A 
26 1 7 1 ES N 8, O, 
26 


correspo 
„hich ponds to our above requirement (2.194) 


d, we remark ' 
indeed that for VWLRTs Concerning the normal th 
mal mean e 


stopping bounds Bo and A given b 

, O y Corollary 2.4.1 sh used 

only if X and B are different. For the ra , Gees 
l case &= ß, we 


refer to Section 2.6.1, Lemma 2.1.8 and Corollary 2.1.5 
(iv) The exponential distribution. We suppose _ 
fox) = 8 exp(-8x), x€(0,0), B8€E(9,»). 
Then we obtain 
p= (1n(@,/8,))/(9, - 9,) 
„here we assume that 8,< H, We note that d(@) = - 9 is a decrea- 


ging function in @ on (0,00). Hence, v (8'.8°) and ¥,(@',@") must be 
determined by (2.185) and (2.186). Since Tel? 2?) ap ef) we 
obtain oi 

Igel: (0'/0") = (8,/8))". 


Further, we obtain 
EN sup = oT) - 1 
H escht H exp(@'F) - 1 
For @'< 0" function y = (exp(@"F) - 1)/(exp(9'F ) - 1) is a non-de- 
1 
. This provides 


v,(e',0") = 


creasing function in 3 on R 
P 


eier pi E SET 
Ch espig H - 1 

A numerical example. We choose 

Q =a 1, 9, = 2, &= 0.05 and B = 0.05. 

and obtain 


KP, In 2 = 0.6931. $ (9:94) = 0:5 and ¥,(@,.0,) = 1.5. 


According to Corollary 2.4.1 we obtain 


= 19.5091, 


By = 0.0517 and Ay 
i dmissible test f 
and test (N,d ) (Un ,0 0, feelt" B on SR e test ror 


ge 2 at level (0.05,0.05). In comparison 


H: @ = 1 against H4: 
he WALD approximations for the stopping bounds 


o 
with it we consider t 
and obtain 

ei. 0.0526 and A 19. 
approximations d 
2.4.2. 


We remark that these o not satisfy the admissibi- 
lity criterion given by Lemma 
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2.5 Monotone likelihood ratio families 


The most powerful property and the unbiasedness of an LRT consi 

in Sections 2.2 and 2.3 were obtained without any additional Me 
tural assumptions concerning the likelihood ratios. As already = 
ted in Example 1.4.1, if (N,&) is a test based on a sequence Dee 
of 1.1.d. random variables with a distribution from an exponentia] E 
CR mers gege ` We eler? exists so that 
n,8.,0 S every nel’ . Now we discuss gone 
consSquénces of such a representation possibility concerning the 
structure of LRTs and especially of WLRTs. Furtheron, we present „ 
monotonicity criterion for the monotonicity of the power function 
of an LRT. 


Definition 2.5.1. A one-parameter family? ={P,, 0 €(8,6)} 


is said to be a monotone likelihood ratio family (MLRF) if for every 


nef'* there exists a statistic T: Q- Ter? so that, for every pair 
0',0" € (0,6), 0'< 6", a measurable function In o'o T R™ exists 
such that 

Logg = In,o' ‚or Tn) (2.195) 
and In,9' ,or(t) is strictly monotonous in t oT. 


If P is an MLRF, then the sample size and the terminal decision rule 

of any given LRT (N, A Is {Ln 9 og BAS opt can be represented 

as follows. _ 

Lemma 2.5.1. Let (N,6)={lL o o an e pn be an LRT for 
as: mt | 


o = 9, against Hy: 0 = Bu, 9<0,<0,<@. If P= <P, 9 € (9,0)} 


H: 
o 
is an increasing function for every ner’, 


is an MLRF where Ba pg .e 
e oi 1 


then we have 


n dP 
inf{n 21: 8 (ce, 9 Ef FRE if such ann exis 
N = z g (2.196) 
oo , otherwise, 
and 
=X (2.197) 
{Ty>4y 9,0 Lie 
o’ 1 
where c e and da ọ oe are determined by 
n,8,: 1 eg 
Si -1 2.198) 
c = (B ) and d = g (A JA K 
n 0,084 ËCH Be: n,@,,0, T 9n,0,,0,° 7 
respectively, ner. 
mi. nef ý 


P roo f. Since P is an MLRF, we have Lie 8. 7 In 0,84 


o’ 1 
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ctions MV 
The fun In,0,.9,' nEeD , are assumed to be increasing, there- 


fore inequalities 


t 


n n,8,.8, n ng ‚9 > An’ nert 


are equivalent to 
We (Biet <q 

< ` - 
n,@..8, n n " Bn 8. ‚a, (An) 9n,9,.9 


1 
and 


ell 
T ée H A e d D 
n (CHEN S TN nef? , 


respectively. This implies (2.196) and (2.197). @ 


A similer assertion can be obtained if g is a strictly mono- 


n,8,.9 


tonically decreasing function for every ner" 


Example 2.5.1. Let (N, 6) = {lig ‚0, Dn A yeep? be an LRT 
1 
for Be : @ = 0. against H. 


O = elt o<9 <0 <0, based on a seguen- 
of. 4.1.4. ER variables {x3 


1 
+ having density 


ner 
fo(x) = h(x)-exp(d(@)t(x) - ¢(@)). 

We suppose that d(O) is strictly monotonically increasing in 9 on 

(8.8). Then, for every pair gë EIS, ©) with 0'< 0” and ner’ we 


have 

Le g" = exP((d(e") - da" )IT, = neler) - c(8')) 
with n 

LE, > t(X,)- 


n=i 


This implies 


gu o: oclfl = exp((d(e") - d(@'))t - n(c(@") - DECHE 


which is a strictly monotonice.ty increasing function in t on R 
Hence, ? forme an MLRF. For 9, o gr: we obtain 


gi, asi = In y + n(c(@") - c(@’)) | y>o. (2.199) 
n,9 ‚9 d(0") = d(@') 
Thus, for ner* the stopping bounds Co 6 o, and daa 0, are deter- 
8 oi 
mined by , 
00” In Ba , n(c(®,) c(@,)) ET 
n, o’ 1 d(@, ) - d(®,) ICH - HCH 
and 
In A n(c(@,) - c(®,)) 
= eae: | SEN + WA UBA i (2.201) 
gd H ,o 
er 1 d(@,) - d(®,) d(@,) - d(@,) 
respectively. 
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Lemma 2.5.2. LetP={P,, 89€ (8,6)} be an MLRF. Let NS) 
K 


RT for H: 8 = @ agai : 
Io, e, nAntner* be an LRT fo e o against Hi: dii 
9<0,<0,<6, and let (N,d) = {hn ot ‚or Ba Antnen* be an Lex et 
H,: 9 = @' against Hı: © = 8", O<O'< O"< 8. Then it is POSSibl, 
D LU t 
choose sequences {Balnet and {Arlnert+ in such a manner that 


N = Ni and d=d'. (2.20, 


This is implemented by 
` -1 + 
el? = ËMMER ner € (2.203) 


and 
i -1 + 
ebe Sn,a' ‚ar(9n,o_,o, (An?) net”. (2.204) 


Proof, Suppose dÉ is monotonically increasing. According 
to Lemma 2.5.1 the critical inequalities of test (N, 6) can be writ. 


ten as -1 Wi 
c =g (B.)<T <g (A) = d ; 
n,9 9, DH. eu n n n,@,.8, n n,6,.9, 
nef", In a corresponding manner the critical inequalities of test 


(N,d) can be written as 
-1 D -1 ' 
“n,8°,8" " 9n,0' ‚ar (Bn)< ThS 9n,g: or (Ap) = da0’ ‚or 
nef", Hence, we obtain (2.202) iff 
(2.205) 


and d D ” = d D 
n,a',o nO, e 


Analogously, this 


Cc P vw = C 
n,@ ,9 n,8,,8, 


nef". which is equivalent to (2.203) and (2.204). 
lemma is established if Jng o iS monotonically decreasing. & 
Te? 


We discuss some consequences of this lemma, considering the subse- 


quent example. 
Ex amp le 2.5.2. Continuation of Example 2.5.1. Let h be defined 
by 

h = (d(@") - d(e'))/(d(e,) - d(8,)). (2.206) 


Since d is strictly monotonically increasing in @ on (9,0), we ob- 
tain h>O. Then by (2.198), (2.199), (2.203), (2.204) and (2.206) 


we obtain 

Bi = Bh (exp(h(c(@,) - c(@,)) - (c(@") - c(e")))" (2.207) 
and 

An 5 An (exp(h(c(@,) - c(@,)) - (c(@") - c(a')))” (2.208) 


for stopping bounds P, and Au: H EP, of test IN, ó) e AL. or On 
Ba Anlnent considered in Lemma 2.5.2, 


Ri 
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Some conclusions: 

(i) Let (n,d) = Vase, Pä en 
against H}: @ = Hu, O<B<1<A< po. Then it follows from (2.207) 
and (2.208) for a given parameter pair 9',8"€ (9, 8) with @'< 0" 
that, as a rule, the stopping bounds B\ and A’ for net" of the 
equivalent test (N',6') = {L E A ent ‚ proposed by Lemma 
2.5.2, depend on Parameters 6',0",Q@ and 8, as well as on the cor- 


1 
responding sampling stage n. Conversely, stopping bounds Be and Ar 


do not depend on n if 


+ be a WLRT for Hj: @ = 8, 


h(c(@,) - c(8,)) - (c(e") - c(6')) = 0. (2.209) 
„au, Equations (2.206) and (2.209) are identical with equations 
(2.31) and (1.32), respectively. Hence, it follows from Lemma 1.6.3 
for the considered exponential family that to any given WLRT (N, 6) 


be, 8, 9, ‚B Aler under the above assumptions the equivalent 


test dp Wes ) = {L gr Be ‚A' anent according to Lemma 2.5.2 is 
again a WLRT iff o” ye (9 94) with h>O. Then we have 
% h U 
Bt = B and A, = ah for neft 


(11) at IN 6.) = Las, 9. Bn Anine rt be an LRT for H. O = H. 


against H. O = 8, whose terminal decision rule dë is defined by 


d. "Zu 


> c,N< oof 
1 


for any given c, O <c < =, By Theorem 2.2.1 this test is an MP-test 


N,6,,0 


for Hj: @ = @ against H,: @ = 8, at level Ee 6 |. According to 


Lemma 2.5.2 we can choose sequences {B"} nent and Ia: ner? for 
every pair 8',0"€ (Ə, 8), @'< Ə", so that 


D inf {n 21: Loo gx È (BAAS) Y ‚ if such an n exists, 
oo , otherwise. 


Analogously, we can obtain a sequence d'H + defined by 


net 
i -1 
d u 9n,0',0"'9n,0 ‚a, 1°) 


= c” (exp(h(c(@,) - c(@,))-(c(@") - c(e'))))", (2.210) 


nef", Hence, for every nef" inequality 


is equivalent to 


> 
ef? BI 7 ka’ 
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If now ÖL is a terminal decision rule defined by 


BS Ly. geen? ki MEY 


then we obtain d. e A Indeed, as a rule, the critical number éi 
at stage ner’ Gene on n so that terminal decision rule 6; m ay 


have a structure which does not coincide with that of a an nel de- 


cision rule of an MP-test according to Theorem 2.2.1. Hence, test 
NC does not need to be also an MP-test for H: @ = gr against 


H.: re) = 0”. 
This seems to be one of the reasons which do not 
We notice that we obtain 


allow to obtain 


uniformly most powerful sequential LRTs. 
a sequence {k* } + of critical numbers, defined by (2.210), which 


ner 
do not depend on nef” if (0',0" A (9.9 1) with h?0O holds. Then 


this additional assumption ensures chat ks (N° LR ) is also an MP- 
test for H. 0 = @' against H,: 0 = O” at level EQ. $ which corres- 


ponds ith: the statement of Corollary 2.2.2. E 


Theorem 2.5.1. Let 9 = { Py, 9€E (8, Eh be an MLRF. Then every 
LRT (N, 6) = {tao o, Bu Ay cpt for Hot @ = 9, against H,: O = 9, 
has a non- EN power function on (®, 8). 


Proof. By Lemma 2.5.1 for every H 10" EIS, 8), 9'< 9", sequen- 
ces CH } ner* and da Sat: Big Ah for nen, exist so that test 


(N',d') = dë g' en 8 Anfner* satisfies 
N = NI and =. (2.211) 


By Theorem 2.3.1 test (N',&') is an unbiased LRT for H. O = 8, 
against H,: 8 = 0". This, together with (2.211), completes the 


proof. BR 
We note that the monotonicity properties of the likelihood ratios 
La, e. 2, for nef” required in this theorem are sufficient but not 


nace ean) for the monotonicity of the power function. Alternative 
sufficient conditions for the monotonicity of the power function 


have been investigated by HOEL [43]. 


2.6 The termination property 
In view of an implementation of a test (N, 6 ) only such tests are 


of importance which terminate with probability one for the parame- 


ters in consideration. Further we remark that the results obtained 


in the previous sections mainly concern these closed tests. 
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Here we will consider a Criterion for the closedness of WLRT (N, 4) 


_ {tn,0,.0,'?’Aner* Since {N =eo} = A {n> n} and {(n > n3} ner? 
n=1 


18 monotonically descending we have 


Po(N <) = 1 (2.212) 


iff | 
Po(N = 00) = lim P.(N> n) = D. 
oO 


n > 


For a WLRT we obtain 


Po(N>n) = P,(L 
o © Ka «seek B,A 
8° 1,0 9} ) n,o .0, © ( )) 


IN 


Pott Er(B,A 
8° n,8,.8, ( )) 


1 - + 
"eloo asbl - Poll, a 9 ZA) ner. 
O 1 “O° 1 


Hence, a WLRT is closed w.r.t. Q if 


lim P_(L e (B,A)) = D 
n =» Ke 9 16,94 u 


or 


L 2A) 21. 


lim Ce BE e Bisi or lim Pei , 


n > co 1 n+ co n,O, 8 


respectively. 


Lemma 2.6.1. Let (N,6) = {L BAS ort be a WLRT for 


n,@,.0, 


H.:0 = 9, against H,: Ha © O<B<1<A< eo, based on a sequence 


1 1° 
Xi nert of i.i.d. random variables having density F(x). If 


(0',0") Ù (O ,0,) then 


Pot (Z4 o „o, = 0)<1 (2.213) 
o’ 1 
implies 
Pe, (N<) = 1. (2.214) 
h 
Proof. Since SËCH He and h A O we obtain SËNN = 1 iff 
= 1. Hence, by (9',0") Are BR, JI and (2.213) we obtain 
n,8,:8, o 1 
h 
Paella ar or = 1) = Pos LL = 1) = Pet = 1) 
g'(lı,o',o o'(t1,0 ,0, AA HEH 
= H {Z = 0) < a 
8 1,95891 
Applying Lemma 1.5.2 for @ H and @, = O" we obtain 
1 
H = 
lim Eg tn ge" d 


n > ec 


, Gen P 
and by Lemma 1.5.1 and (9',0") w (93:91) 
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h 
0) = Pg.(lim Lena" Hi 


8 as n,@' ,e” en 0.9 
= Po (lim L = 0) = 1 
9 n -+ co á 05191 


This implies 


lim Sai 
n => 00 Po: n, 8, KA 


and this is sufficient for (2.214) as stated above. 
If we are interested in an upper bound for the probability Po(N> n) 
of a WLRT we may use the following result by STEIN [74] . 


Lemma 2.6.2. Let (N, ó) = A? o og BA}, er" be a WLRT for 
d kee, 
O<B<1<AS&, "7" on a sequence 


B) = 1 for B70 


Ho? O = 8, against H,: H a Hu: 
of i.i.d. KE variables having density f g(*)- 


CH 0)< 1 (2.215) 


then constants O< c< Pi 


Pa{Z 
@ 1,0, 8 
and O< Q< 1 exist 930 that 

Pg(N> N) < ce" (2.216) 
for sufficiently large values of ner* 


Proof. If p2z = O and (2.215) holds then (2.216) is evi- 
e" 1, 8, ‚9, 


dent. For Be, o. 2, 2 O we consider the probability P o(N?>er) where 


n integers. Since the {X ingert are i-t. d. also 


m and r denote bat 
are i.i.d. for k = Eaëfsssen 


the increments D, o ,0 - Zur, o. 8 ‚| 


1 
for d = In B and a = 1n A we obtain 


mr where 24,0, 9. 7 O. Hence, 


"a 
Po (N >mr) = Fei? 9.8, © (b,a) for k = uw, ) 


£ PolZk 0,04 € (A for k = r,2r,....‚ar) 


< Pol |Z - Z < a-b for k = r,2F,...: 
o|7x,e,,0, ~ “k SEH SS 


1 
= (p.tI|z wey)". 2.217) 
( el 8.847 ° )) ( 


Let Y, be defined by Y, = Int fg, (x, Life ali, iert. Then the 


(Where are also i.i.d. and E Be 


PollZ, 9 al a-b) 2 rol > Ys vz a-b) 
vw i=1 


2 Po(Yır a-b for i= 1... 
r 


m Pre" (2.218) 
r 
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n 
In an analogous manner we obtain 


(| 
oll Ze o > a-b)> (Pp_(y a-b, ,r 
d 58, ) ( ol .< = ——)) Se 


Furthermore, it f 
’ Ollows from 2.2 
there exists a (2.215) that Po(Y, = O)<1. Hence, 
constant q>O so that 


Paty > a-b > = 
wae ee or e eS = Bs. (2.219) 
r 


for sufficiently large values of r 


Now, ifn= nr +k with ken" e 
by (2.217) to (2.219) we obtain ` 


CH e < 
and olN> nje Po(N>nr)<(1- g’)" 


7 (i = CN (1 - gh) (4/r) (rm + k-k)_ ee H 


g= (1 - art 


and Cc = 9 S 


This completes the proof. W 


oO 
Since {N = co} = Vw nj and {{n > d ner? is monotonically des- 


cending we obtain by (2.216) 

CH = 00) = lim P(N > n) = lim ee = 0 

n > 20 n =» 09 

so that (2.216) ensures that N terminates with probability one. 
The property (2.216) will be described by saying that N is exponen- 
tially bounded w.r.t. 8. This notation, introduced by BERK [12] , 
takes into account the fact that under the conditions of Lemma 2.6.2 
a real number to? 0 exists so that Egexp(tN) < co for every t<t, 
(see Lemma 2.7.1). Further aspects concerning the termination pro- 
perty of LRTs and exponentially bounded stopping times are consi- 


dered by [13],[65],[68] ,[81] and [82] . 


2.7 The average sample number function 


The average sample number function (ASN-function) is beside the po- 


wer function one of the most important characteristics describing 


the statistical properties of a sequential test. If the test under 
consideration is a test based on a sequence IT Kee of statistics 
we may obtain assertions on the ASN-function by means of so-called 
Moment equations are representation formulas for 
ion values of the variable 

‚ner*. walo [77] 


moment equations. 
the moments involving beside expectat 


Zu o o also expectation values of statistics T 
U o D 1 
used the so-called fundamental identity to obtain moment equations 


for the average sample size. These moment equations may be obtained 
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also in a direct manner applying methods of the computation of exp 
ec. 


tation values of randomly stopped sums (see e.g- CHOW et al. [22]) 


We start here with a classical result concerning the existence of 


the moments of the sample size of WLRT IN, éis ETS 
i.i.d. random variables. Moreover, 
for the first moment of the sam. 
d to obtain lower bounds 


based on a sequence {xA nert of 
we will consider a moment equation 
ple size of a WLRT which can be use 
for the average sample size of a WLRT. 


B,A} + be a WLRT for 


Theorem 2.7.1. Let CEA u {Ly 0, 104! nef 


H : @ = @ against Hy: O = 0}; O<B<1< A< ©, based on a sequence 


o 
{x} ert of i.1.d. random variables having density fo(x). If 


Pa(Z1,0 0, ” 0) <1 then 


E NÉ < oo for every ker’. (2.220) 


To establish this theorem we need the following result concerning 


the moment-generating function of N. 


Lemma 2.7.1. Under the conditions of Theorem 2.7.1 a finite real 


number t 7 2 exists with 


Egexp( tN) < eo for every t<t,- (2.221) 


P roo f. Applying Lemma 2.6.2 we obtain 


Eo exp(tN) = > exp(tn)Pa(s = n) 


EN 
oo r 
= > exp( mr+j)t) Pol e mr + j) 
m=O j=1 
oo r 
= oxp(nrt) > exp(Jt) Pol = mr + j) 
m=O j=1 
< exp(mrt) exp(rt) Po(N> mr) 
m=O 
ee 
< exp(rt) > explart) Ce mr 
m=O 


c-exp(rt) > (exp(re)g "Vë - rem’. 
m=O 
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eo 
> (engt rtye J converges iff 


m=0 
t<- Ing = t, and we obtain (2.221). M 


e 
exp(rt)e < 1. This is equivalent to 


Proof of Theorem 2.7.1: We note that for 
a finite n'EF* exists with 


k 
n < exp(nt) for every n>n'. 


every ke * and o<t<t, 


Hence, we obtain 


k eo 
Ech = > vrai = n) 
n=1 
n'-1 Be 
m > deit a dai dd = n) 
n=1 nen' 
<(n' - 1)* + Dexp(at) Poel = n) 
n=n' 


¢(n' - 1)* + Egexp(Nt) 


which is finite because of n'< vo and (2.221). W 
We now tend to a moment equation which is known as WALD's equation. 


Theorem 2.7.2. Let N be a sample size based on the sequence 


of statistics {Ta inert: We suppose that the (Aaen? are indepen- 
dent with the same mean EoTı and Eg!T,| < oo, If E GN < 00 then we 


have (2.222) 


Proof. We follow WOLFOWITZ [83] and JOHNSON [47]. By the defi- 


nition of Ty we have 


eo n oo. oo 
Ty DURA 221 fin) 
n=1 i=1 isi n=i 
Dei eo FO 
E pir X {Nan} = > VE {n2i}' 
isi n=i i=1 
This implies = oo , z | 
Eoln = X Eoi X {n> ff Pins iy Fol "il * {n> 1} 
isi EN 
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provided the interchange of expectation and summation is Justified, 


We have: 
(i) (ED {n>i- 1} does not depend on Y,,Y,_4++-- This implies 


Eo(Y, IX ino ay) = Bei = EgYı 
(ii) E oX {n> 4} = Po(N> i), 


(iii) x Age > rath? => > Fei = n) 


Ae? i=1 nai 
co 
nei isi n=1 


Then (i), (ii) and (iii) imply EoTn * eh EgYı° The interchange of 
expectation and summation is allowed if the series is absolutely 


Convergent. Consider 


eo gei 
> Fol YIX cna atl < > EolYilEoX {n> n} = Eo lY; l EQN. 
i=1 - es? 


This is finite because of Egly, |< and EN < © „ Thus, the proof 


is complete. E 


By means of moment equation (2.222) we may obtain a lower bound 


for the average sample size of a closed WLRT. 


B,A} + be a WLRT for H: 


ss m m = 2.7.2. Let (N, 6) "Lag. 8. ner 
‘Oaz 8, against H,: 6 = el O<B<1<A<eo, based on a sequence 
{X ne of i.i.d. random variables having density f g(*). If 
Po: (21,0 ‚e, = 0,<1, E,.1Z, 10,18, |< œ and (ër, ër wu (0, .8,) 


then 
(1 - Mët In L= MOO") , wen in MEN 
Eg:N > eg A ne), , (2.223) 
971,00, 


Proof. By Lemma 2.6.1 we obtain Eg: N < eo., Applying Theorem 


2.7.2 we have 
Eo: Zn, 8, ‚8 = Eg'2ı,o ‚8 $ EoN, (2.224) 
1 o’ 1 
Otherwise, by Lemma 2.6.1 we obtain Pg (N<) = 1. This implies 


EG: ZN, H. 8, = (1 = MO NEG (Zn 00, 10, | Ho is accepted) 


+ M(O")EQ, (Zu, 0, 19, | H, is accepted). | 
(2.225 
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By (9',a") & (6, Bal, Jensens' inequality and Theorem 2.1.1 we obtain 


Eg: (2y 9 e | H, 18 accepted) = d Eg (PZN o ‚9 | H. is acc.) 
oi) h o 1 
= $ Eg: (In 6,0, 8, | H, 19 accepted) 
< = ln er (iaa, o Lr is accepted) 
=å in AZM . (2.226) 


Analogously, we obtain 


in DAS , (2.227) 


E..(2 IH is accepted) e 
@'"N,0 60, 1? wer? 


m |» 


Hence, (2.224) to (2.227) imply 


Eo:21 o o Eg Ne ((1- m(o')) in LM) , wor) an MD 

Zerf? h 1 - M(Q') Mm(9') 

h (2.228) 

Now, by (8',8") a~ (9, .8,) and Jensens' inequality we obtain 

E9219 0, 7 = Eg:hZs 9 9 == Eg'2ı,0' ,o" 

gës alee : h ro" 61 h D ' 
1 
= ia Eg: In ËCH 


1 1 
< h In Eg'lı,,o' gx = h ln 1 = 0. 


Hence, dividing (2.228) by Fe'“1,0,,9, we obtain (2.223). E 


The bound given by (2,223) may not be the greatest lower bound for 
Eyg.N. We refer in this context to HOEFFDING [ 41] and [ 42] who has 
derived certain further lower bounds for the average sample size. 


Corollary 2.7.1. We suppose that Lemma 2.7.2 holds where 
VC =z of and M(9,) = 1-8, 


Then B 1 -B 
(1 -&) In 77x + «X In 
Eg N2 E (2.229) 
oi Ba £ 
¥ 1,8, ,9, 
and 
B 1-8 
B ln + (1 - Bi In 
EN — SE nn EIER a ri (2.230) 
A Ea Z 
9, 1,0,.0, 
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Proof. This corollary is an immediate conclusion of Lemma 2 
1 (9, .0,). respectively, W iá 


E N m 
( 0.98.) N (8581) and (01:83) nm 
By means of inequalities (2.229) and (2.230) we may assess the „ 

“Den. 


se which at least is required if we are interested in a WLRT for y 


RH = 
©, against H,: @ = @, with probabilities x and B of an error of 


first and second kind, respectively. 


Corrillear y 2.7.2., We suppose that Lemma 2.7.2 holda where 


` k -= B| Be is acc.) = Polina ‚eo, ge IH, 1s acc.) 


orl 


N,8,,0, 


Then 


1 - M*h)) In B + M*(h) In A 
(2.232) 


where M*(h) is defined by (2.21). 
Proof. If (2.231) holds we have M(0') = M*(h), Ego (Zn o ol 
, oi 1 


H i = = 
> is accepted) = In B and Eo: (Zn 0 ,0,! H} is accepted) = In A 


This, together with (2.224) and (2.225), provides (2.232). 


If instead of (2.231) we may only suppose that the excess at termina- 
tion is small then (2.232) holds only approximately and the right- 


hand term of (2.232) is the so-called WALD approximation for the 


ASN-function. 


2.8 The optimum property 


The WLRT possesses a quite simple structure. Nevertheless, it pos- 
sesses a surprising optimality property for the first time proved 


by WALD, woLrowıtz [78]. 


Theorem 2.8.1. Let (N, 6) -(bn,0 0,8 Anert be a WLRT 


H against Hy! 0 = 98,, O<B<1i<Ac O , based on a sequen- 


for Ha! 0 =8, d 
ce of i.i.d. random variables. Let (N, d ) be any other test for 


these hypotheses. If the true risks ek and (9, ) of (n, 4) and 
mw J N N 
x (0) and B(@,) of (N, 6) satisfy 


8(8,) © 8(8,) (2.233) 


&(8,) € X(9,) and 


then 
(2.234) 
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de space of this booklet does not allow to present a complet f 
of this theorem. The main idea of the classical proof ei ne 
m consists in the verification of the fact that a WLRT më cer- 
gain Bayes test in the sense of decision theory. We refer in this 
context to WALD, WOLFOWITZ [78], woLFowrtz [84] , LEHMANN [53] and 
GHOSH [35] where proofs of this theorem are garen? under the 
additional assumption of closedness of the considered tests. BURK- 
HOLDER. WIISMAN [20] have shown that this assumption is not neces- 
sary- other optimum proofs have been given by MATTHES [58], SCHMITZ 


[67] : LORDEN [54] and IRLE, SCHMITZ [45] where also the optimum pro- 
perty © arameter is 


establishe 


re 


f a WLRT for processes with a continuous time p 
d. We further refer to SCHMITZ [68]. - 


property of a WLRT characterized by the above theorem 
a pointwise optimum property which can be expressed 


Among all tests whose error probabilities do not 
st possesses the smallest 
In view of compo- 


The optimum 
is, of course, 
also as follows. 
xceed those of the given WLRT this te 


en under both hypotheses. 
eter is given the optimum 


s of the conjugacy 


e 
average sample size giv 


site hypotheses or if a separating-param 


property of Theorem 2.8.1 can be extended by mean 


concept as follows. 


2.8.2. Let (N, ó) Tan, 10,8 Anert be a WLRT 


for Ha: 9 = Be against H,: 9 = 84, 8<®,< ER) O<B<1<A< ©, 
based on a sequence Aaen? of i.i.d. random variables. Suppose 
there exist parameters 8 and 8%. DEEM Eh ð, so that 

(i) for every CN? (8,95) there exists a o" € (03.8) where ve: ci È 


(0,94) with h>O, 
(ii) for every ch CHE 
(0:841) with het, 
Let (N, 6) be any other tes 
note by M(@) and M(e) the powe 
spectively. Then 

me) < mo) for 9<9 (2.235) 


Me) me) for 


Theorem 


8) there exists 4 9” € (9,05) where (8',9") A 


8 = ©, against H,: 
) and ( 


ZU © 


t for Hai 
r function of (N,d 


# 
and e 
EEN (2.236) 


imply 
(2.237) 


+ “=< 
EQNS EgN for gt (0,0%) Y (04.9). 


Then, there exists a 9" 
his implies L, 9: 9 


Proof. (i) We suppose Ch € (9,0%). 
% =— 
SC with (0',0") © (9194) and h>0. T 
` for ner” and we obtain 
1 
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h h ,h 
(n,d) = aan P Aner? ~ Log. ‚0, °° e Inert 


h ,h 
= duer ‚gr 8 ‚A Let? 


so that test (N,6) is also a WLRT for Hei 9 = H against Hy: @ = gr 
with stopping bounds O<B <1<A < © . Applying Theorem 2.8.1 we 


obtain 
E “ D LU 
N< EN for @e(e',0 a (2.238) 


= 
(ii) We NES? CN? (81.0). Then there exists a o“ e (9,07) with 
(8',0") ~ (@ 94) and h<O. This implies (9",0') ~v (9,,9,) with 
— h>Oo 2 = ? 

and e HH Lo 0,10, for every nel so that 


ana TAN ner‘ 


holds. Applying Theorem 2.8.1 we again obtain (2.238). This com- 


pletes the proof. W 


The conditions of this theorem are fulfilled, for instance, if we 
have a sequence {X Snert of i.i.d. random variables having density 


fo(x) = h(x)-exp(d(@)t(x) - c(@)), xe X, 9E (9,0) 
where Lemma 1.6.4 holds. Then, to given g<e <e,<® a uniquely de- 
) exists. Furthermore, for 


termined separating-parameter goe (9,0 
*> o* so that 


every geg there exists a corresponding 8, 


(95 8") we 5 (84 8") 
holds according to (1.57). 
dence between the elements of (9,9%) and (9X of 
conditions (i) and (ii) of Theorem 2.8.2. Then every test (N, A ) 
whose power function intersects the power function of (N, 4) bet- 
ween oh and 9, as it is required by (2.235) and (2,236) 
the optimum property (2.237). A special case arises if we choose 


o> = 0" = ht Then, if E,N is a continuous function in RH on (9,8) 


Hence, we obtain a one-to-one correspon- 
KEN in the sense of the 


possesses 


we obtain 
[nd s- 
EQNS EQN for @€(0,@). 


under the conditions of Lemma 1.6.4. 
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3. The computation of the characteristics 


» we refer in this context 
also to the corresponding improvements o 


for these characteristics 
PAGE [9] e 


f the WALD approximations 


given by KEMP [50], PAGE [60], BARACLOUGH, 


th 
ere exists a Comparatively small number of investiga- 


tions concerning direct methods for the computation of the power 


function and the average sample size (see GHOSH [35] , GOVINDARAJULU 
[37], JACKSON [46] , JOHNSON4[ 48] ). As a rule, direct methods are 

characterized by special assumptions about the probability distri- 
bution of the random variables Considered there 
AROIAN, ROBINSON [ 6]) 


kelihood ratio Zu E ‚9 


(see e.g. ALBERT [2], 
- In those cases where the logarithm of the li- 


, is a random variable that only takes on a 


finite number of values which are the integer multiple of a given 
constant WALD [76], [77] used for the direct computation of the 
operating characteristic function the moment-generating function of 


Zug 8. and the fundamental identity. To obtain assertions about 
o 


the operating characteristic function by this method we first have 
to determine the roots of a polynomial equation and second to solve 
a system of simultaneous linear equations. For the same situation 
GIRSHICK [36] has proposed an alternative method which involves sol- 
ving a system of linear equations. The number of linear equations 
depends on the values of the stopping bounds and the constant men- 
tioned above and may be very large in practical situations. 

BURMAN [21], POLYA [64] and WALKER [79] considered exact formulas 
for a Bernoulli population. Finally, under the conditions of [36] 
and [76] it is possible to describe the operating characteristic 
function and the average sample size by means of difference equa- 
tions (see e.g. GHOSH [35], Chapter 3.7) but the solution of these 
difference equations, in turn, requires the computation of the roots 
of a polynomial equation. All these methods do not allow to compute 
the operating characteristic function and the average sample size 
for truncated WLRTs. 

Bartky [10], JONES [49] and BERNSTEIN [14] used the method of vector 
Summation for the computation of the probabilities of acceptance. If 
some assumptions about the continuation region were fulfilled, they 
obtained assertions about the operating characteristic function and 
the average sample size after the inversion of a matrix. AROIAN [5] 
used an approach based on Markov chains. This approach is without 
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additional assumptions, e.g. a samll number of stages of the san 

ling plan or special assumptions concerning the underlying dë, 
bution, for the Bernoulli distribution we refer to [27], very Se 
borious from the numerical point of view. HALD, M@LLER [38] used a 


similar approach for the design of two-, three- and seven Stage 


sampling plans for the Poisson and Bernoulli distribution. Direct 
methods for the computation of the moments of the r order, EE 


of the sample size seems to be unknown so far [34], [57]. 

By [28] a method has been developed allowing direct computation ep 
the operating characteristic function, the power function and the 
moments of an arbitrary order of a WLRT based on a sequence of iid 


integer-valued random variables. There, we only have to suppose that 
WLRT is a rati, 


in practice we 
of dist ribu- 
Bernoulli, 


the slope of the acceptance or rejection line of the 
nal number. This is a quite weak restriction because 
are always forced to use rational numbers. The class 


tions considered in [28] includes, for instance, the 
Poisson, geometrical and negative binomial distribution. The amount 


of numerical calculations is comparatively small in comparison with 
the methods mentioned above. Mainly elementary vector operations are 
needed. The computation of more general characteristics of a WLRT 
by means of the method presented in [28] is investigated in [30]. 
An application example is described in [31] where the substitution 
of a sequential sampling plan for sampling by attributes by a sam- 
pling plan based on a sequence of Poisson distributed random variab- 


les is investigated. 
Following [28] and [30] we will present a method for the computation 


of the characteristics of a WLRT based on a sequence of i.i.d. in- 


teger-valued random variables. In Section 3.1 we start with the in- 


vestigation into some geometrical 
region of the considered WLRT. In 
method for the computation of the 


veloped under the assumption that 
rejection line of our WLRT is rational. In Sections 2.3 and 2.4 


to the computation of the power function 


properties of the continuation 
the subsequent section a direct 
characteristics of a WLRT is de- 
the slope of the acceptance or 


this method is applied 
and the moments of the sample size which can be reduced to that of 


solving of systems of linear equations which differ in their right- 
hand sides only. In Section 2.5 the computation of the distribution 


of the sample size of a WLRT is considered. 


By means of the method for the computation of the power function in 
Section 2.2 it will be possible to obtain admissible WLRTs with @ 
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sample size as emall aa possible. The corresponding procedure is de- 
scribed in Section 3.6. 

The procedure of Section 3.2 is adapted to WLRTs based on a sequence 
of integer-valued random variables. Since one may discretize almost 
all statistical problems further application possibilities arise by 
suitable discretization of continuous problems. In connection with 
the so-called grouped observation a corresponding discretized se- 
quential test procedure is considered in Section 3.7. We shall see 
that by means of the method presented there also test problems can 
be solved for which fixed sample counterparts are not known 80 that 
a further advantage of sequential tests over non-sequential tests 
will arise. 

Moreover, an essential adventage of the method of Section 3.2 is 
that it can be extended to the computation of the characteristics 
of truncated WLRTs. For the power function and the moments of the 
sample size this will be done in Section 3.8. 


Finally, we will consider in Section 3,9 a continuous inspection 
scheme for detecting a parameter change by means of a sequence of 
repeated WLRTs. Applying the methods of Sections 3.2 to 3.4 we will 
present a method for the computation of the average run length of 


such sampling schemes. 


3.1 Properties of the continuation region 
Consider a closed WLRT (IN, dis {ty,0,.0,°8 ner’ for H: @ = Se 


against H,: H = Hu, O<B<1<A< œ , based on a sequence ser’ 
of integer-valued i.i.d. random variables and suppose that 
n 
+ 
?n,8,.%, = ln Lag ‚9 = Ge KU = Yor: ner ` (3.1) 
o’ 1 
i=1 
for any given $o YE (-9,+%), Ý, + O. We generally assume that 
¥,> 0. In case of Y} <O the investigations are completely analogous. 
Then critical inequalities 
+ 


ln B < SÉ? < In A, ner, 


can be written as 


n 
Yo ln B > Yo ln A + 
2o LS g Ae an —— , a .2 
SS 2Sa" A ns SZ? 


We remark that our assumptions are fultilled, for instance, if we 
have a sequence of i.i.d. random variables {Xaine ct with density 
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CR - c(8)), X excl . e€@®cri (4.3) 


fo(x) = h(x)- exp(d 
d in © on © Th 
where d is strictly monotonically increasing + e Then we 


obtai 
ain and Yo = c(9,) - c(@). 


Le = d(9,) - d(9,) 
tion class contains, e.g., the Bernou] 
ial distribution, If g* 


(1.58) then we obtain 


and the considered distribu 
li, Poisson, geometrical and negativ® binom 


denotes the separating-parameter given by 


c(0,) - ee.) te) 


Yo 
d' (9%) 


Ya d(0,) - 4(@,) 


for family (3.3). Moreover, if E9%ž1 = 9, we obtain even 


"3 


GE 
Ss"? 
since E,X, = c'(8)/d'(®). 


O 1 
We investigate some structural properties of th 
of test (N, 6 ) under consideration. Since the random variables 


{X Iner* are assumed to be integer-valued the continuation region 
scribed by means of a set of lattice points. 


e continuation region 


of our test can be de 
Under the above assumptions let M be the set of lattice points gi- 


ven by 
+ ‚Yo In B Yo , in A 
M = {ink Eror : on n + Kg ged n e Ir (3.4) 


then, for n = 1,2,..., we continue sampling as long as the points 


n 
of the sequence (2%)! , belong to set M. If on stage n 
izi nel’ 


critical inequality (3.2) is violated for the first time we stop 
sampling and accept hypothesis Ho or H, if 


n y y n 
ln B o ln A 
x S2 nt — or —n + — < X. (3.5) 
2 ia Zi Y1 Yı 2. i’ 
e i=1 
respectively. Hence, we obtain 
n 
N = inf In 1: hn. ALLI 
i=1 


and 


N 
ó ger X.2 Yo + In A e 
2 i? A N Yı e N< oof 


In view of this representation we may regard lattice point (0,0) 
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arting point for the t 
„o the st z est (N; d) or the sequence of lattice 
em pints (OA ler More general we may use also each other 
i=1 
joint of Mas a starting point for a WLRT for H_: 9 = @ against 
e Oy. o o 


H H 
1 
pinition 3.1.1. Under the above assumptions we shall 
jay a WIRT (N, ó) = (oe ob AL enn for Ho: @ = 9, against Hy: 
g = 9 based on the sequence {x Aer? starts at the lattice point 

(m, k)EM if we proceed as follows: 


(i) For n = 1,2,... we continue sampling as long as 


n 
fo „ae Yo In A 
ag +n) + A <k + DH +n) + "e ! (3.6) 


(ii) We stop sampling on stage net" and accept Ho or reject H,. if 
on this stage 


Yo In B 
> m+i Ti Yı 
i=1 
Y n 
o In A - 
— < k , 3.7 
zl +n) + f; + D ( ) 


holds, respectively, for the first time. 
We denote such a test by T(m,k). 


Denote by N(m,k) and ö(m,k) the sample size and the terminal deci- 


sion rule of test T(m,k), respectively, then we have 


n 
N(m,k) = inf {n?1: (m+n,k + > Kent) EN 


and = 
N(m,k) 
d(m,k) = K(k + A Koi Zi + N(m,k)) + AË Minkie oo). 
i=1 


Evidently, tests (N, 6) = IL, o en and T(0,0) are iden- 
D oi 


tically. 
We remark that it is also poss 


conditional WLRT for Hai 928, against H,: O = 8, based on (x Iner* 
we Hays reached lattice point (m,k) €M 


ible to interprete test T(m,k) as a 


under the condition that 
after m observations. 
teristics like, for instance, 


Before we start to compute the charac 
the sample size of test (N,6 ) 


the power function or the moments of 
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we will consider some geometrical properties of M. 


Definition 3.1.2. Two lattice points (m,k)EM and (m',k') 


EM are said to be equivalent (write: (m',k') © (m,k)) iff 


Co Yo 
k = — z : = emus . e 
A n k Yı m 


By this definition equivalent lattice points of M are characterized 
by the same distance to the straight line of acceptance y(n) = 
(Fo/tı)n + (In B)/¥, or to the straight line of rejection y(n) = 
(Ko/ty)n + (ln A)/Y,: respectively, taken in the direction of the 
ordinate, 

The following lemma describes the situation where different equiva- 
lent lattice points will exist. 

Lemma 3.1.1. To any given (m,k)EM at least one further lattice 
point (m’,k')EM exists with (m,k) ® (m',k') and m & m' iff Yo/ ¥4 
is a rational number. 

Proof. (i) Suppose (m,k) & (m',k'), m $4 m'. Then (m,k) % (m',k') 


implies 


Yo ki =k - 
Yı m' -m 


Since m' $ m and k,k',m and m' are integers FR is rational. 
(ii) VLo/Tı is rational. Then integers Jo and 9, # O exist where 
ZE = 90/94 ° Let (m',k') be defined by 


m' =m + 94 and k' = k + Jo’ 


Then we obtain 


Zo Zo Yo vo 
kr emm ` eee s = k = — = — = emm ` ees 
m A m+g, da k 3 m 


and m $ m'. This implies (m,k) © (m',k') with n A nr E 


The importance of the existence of equivalent lattice points in M 
will become clear in the following section. There we shall see that 
tests which are started in equivalent lattice points will have the 


same characteristics. 


3.2 The computation of the characteristics 


Let (N,d) = Ia a, 2 Inept be the WLRT considered in the pre- 


vious section. In the sequel we will investigate the computation of 


the characteristics of this test if ¥o/¥, is a rational number. This 
task is embedded into the more general problem of the computation of 
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garacterietics of test T(m,k) for (m,k)EM. 


ote by s(m,k) for (m,k)EM the randomly stopped sum 
pen N(m,k) 
s(m,k) = k + > Kati ` 
i=1 
further Z(m,k) be a random variable defined by 
Lë N(m,k) 
z(m,k) = äalk * 3 Xari) = An + N(m,k)) 
i=1 


= g} S(m,k) - g (m + N(m,k)) 
tor (m,k)E M. If g, and 9, are integers then Z(m,k) is an integer- 
yalued random variable. If we may suppose that 


fo _ 390 


u. Bett. +0, (3-8) 


we obtain the following relation between the likelihood ratio 
and Z(0,0). 


"N.B cÉ N(0,0) 
ln L =» Z = X, = N(0,0) 
e N,8,:9, N,@.,8, Yı 2 i To 
N(0,0) 
= d > X, - — dE 
Lei 1 
t N(0,0) 
-— (g, >. X, - 9,N(0,0)) 
"i {=1 
„U 200.0). (3.9) 
94 


Hence, under the assumptions (3.1) and (3.8) any characteristic of 
type 
E Fa, 
Fal ue. gl get 


can be reduced to the expectation value 
E w(N(O 0) engl 2 2(0,0))) , @€ ©. 
8 s 94 


For this reason, we will consider the computation of characteri- 
stice of test T(m,k) which can be represented as expectation values 
of type 

Egw(N(m,k) .Z2(m.k)), , ge Il, 
for any given function w: Daf +R. If we are able to calculate 
Such expectation values we may also compute the corresponding cha- 
acteristics of test (N,6) = {Un .0,.0, "ner" 


113 
8 Eger, Tests 


Lemma 3.2.1. Suppose that 
(3.10) 


Ze. Yo | gog EF ` 94? 0O. 
Via 1 
If (m,k) © (m',k') and Egw(N(m,k),Zz(m.k)) exists for 9 €® then 
(3.11) 


Egw(N(mek).Z(mek)) ~ Sai Min" k’) Z(m',k')), ge CO. 


Proof. Consider the distributions of (N(m,k),Z(m,k)) and 
Since (N,d ) e {bn ,0,,0,/° ner? FR ZE 


(N(m',k'),z(m',k'))» 
to be closed here also tests T(m,k), (m,k)EM, are closed. By (3.10) 


critical inequalities 


n 
In B Yo ln A Yo 4 
E + zip +n) < k+ X < + (m+n), ner’, 
DÉI Si L Di Yı I 
sre equivalent to 
n 
Zo Jo + 
Sf jn BR e (k + X ) =- g. (m + n)< — 1n A, ner”, 
Yo Hi >. med fe) Le 
i=1 
Hence, we obtain 
Po(N(m,k)<o) = >. Pg(N(m,k)=n,Z(m,k) & (22 In 8,28 in àj) 
e Yo "ZS 
e 1, 0e®. 


This implies 


Po(N(m,k)=n,Z(m,k)=z) = O for (n,z)er*’xr 


g g 
with gelt In da In A). Analogously, we obtain 
o 


Q 


Pg.(N(m',k')an,Z(m',k')=z) = O for (n,z)er*’xf 


go Jo + g g 
and z€ = In B,— In A). For (n,z)EP*xf with z& (— In B.—2 lnA 
3 % de: leie A) 


0 
we obtain ? j 
P N m,k =n,Z m,k = = P _o ` i 
i=1 
n 


< ınar 

— ln al,...,Nn- _ p . 

fo or j n-1 and 94> Nat Jon*+94k 95m z) 
En (3.12) 


and 
J 
Po(N(m',k')=n,Z(m',k' Jo 
" ' deih Al = Pol 1 ; 
: Yo = 94> Ber “95d+94 
i=1 


ch & 
-g M Le — ln A for =1,.. = ` 
ef Y Zäiten, and 91> e si” Iontg4k "Be "SI, 
i=1 
(3.13) 
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| 


E o 1 ` 
This: together with (3.12), (3.13) and the i.i.d.-property k 


(xtner* , provides 
Po(N(m,k) = n,Z(m,k)=z) = Po(N{m',k')=n,Z(m',k')=z) 


+ g 

r e ei g 

„iso for (n,z)ET" "x with z¢ Ka In B,— In A) which completes the 
em o Yo 


An immediate conclusion of this lemma is that tests which start at 
equivalent lattice points will have the same characteristics. By 
means of this property we can obtain recursion formulas for the 
computation of the characteristics of tests T(m,k), (m,k)EM. Fur- 
thermore, depending on the structure of function w under conside- 
ration it will be even possible to modify these recursion formulas 


to systems of linear eauations in certain cases. 


We introduce the following notations: 


«I (Mm) = min { ker: k > Yon. me), net": 


¥4 Zi o 
(1) e P Yo In A +. 
k (m) max { kef: k < Yı m + KS : mel; 
Kim) = (ker: Väiteisekeviilrtank, mert; 


K(m) =P - Kim), nEI ; 
we(m) = Egw(N(m,k),Z(m,k)), (mk)EM, 0€ ©; 


W (m) = Cwe(m)} ke K(m)! 


WA em) = Egw(g, + N(m,k),Z(m,k)), (mk) EM, oe: 


9 9 
weap (m) = {wry ibe K(m)’ 


J 
Cu. (m,m') = WEE k + > AE for j=m+1,...,m'-1 and 
i=m+1 


m` 
k 4 > X, = k'} - the event of reaching the lattice 


i=m+1 
‚k')€ eet by test T(m,k), (m,k)EM, mom’: 


point (m' 
H 
okk (m,m) Eelëu Ian li, 9 €O; 


H 
C (m,m') = CARCERIS kEeK(m),k'EK(m')’ 
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Ə a e Ve a å 
cp. (m,m*) dn (mm y} ke K(m)’ k E K(m E 
H 
E - unit matrix of the same type as C (m,m+g,). 


Then we obtain the following recursion formula. 
Lemma _ 3.2.2. Let (N,Ö) "lte, 0,8 nent be a Closed WLRr 
based on a sequence {X nent of i.i.d. integer-valued random Variah. 


les, where n 
e e AN 
9, Yı 2 X fon ner’, 
i=1 


Z 
= POS yx oo, OST, ** - Suppose that 


Yo Be 


DR. 


D 9° Ioe . 9,>0. So) 
Then 
wm) = Pim) + c°(m,m+g,) Way (™) (3.15) 
with 
94 
ea = ST Mn. (Sag 


n=1 k'€K(m+n) 


Pr oo f. Consider the system of events 
(ETH Ce mma eR megs)! 


HATTEN (3.17) 


for (m,k)E M and k€K(m). This system forms a complete system of 
pairwise mutually and exclusive events. Then, by the formula of total 
probability, it follows 


94 
wim > Eg(m(N(msk) ,Z(m,k)) | Co. (mymen)) 
nal k'€K( m+n) 
"Fei, (8, penil + s (3.18) 


et =D Eg(w(N(m,k) .2(m,k)) KIT EE 
k'eK(m+g,) (3.19) 


for every kCK(m). According to the definition of the events 
Ckk' (Memen) we have 


Eg(w(N(m,k) ,Z(m,k)) | Chis (m,men)) = w(n.g7k‘ - g (msn)) (3.20) 


for n = 1,...,94, KEK(m) and k'e K(m+n). Consider the conditional 
expectation values in the sum 8) and put k' = h + g,. Since the 
(Auer? are assumed to be i.i.d. random varinbles "applying Lem- 
ma 3.2.1 we obtain 


Eg(w(N(m,k) ,2(m,k)) | Ckneg (9494) 


= Egw(g,+N(meg, sheg,) .g,S(m+g, bag, )-g pn ga Mi m+g4 -h49,))) 


Egw(g,+N(m+g, ,h+g.) .2(m+g, .h+g,)) 


Eow(g,+N(m,h),Z(m,h)) 


Q 
Eta), hf) 


for h€K(m). This, together with (3.18), (3.19) and (3.20), pro- 
vides (3.15). W 


Based on this lemma we may compute vector W°(m) if in addition to 
the corresponding transition probabilities Roses? A, (m) is known 
so that the computation of the characteristics w (m) ER k € K(m) 
can be reduced to the computation of the characteristics Wi 1), Cm) 
for k€ K(m). In certain oe the computation of WÉI (m) will lead 
again to the computation of w Bra so that recursion formula (3.15) 


becomes a system of linear equations. 


Theorem 3.2.1. Suppose that Lemma 3.2.2 holds. If 


1 


w(g,+n,Z) = c-w(n,z), GER, (3.21) 


then 
(E - c-C°(m,m+g,)) W(m) = Wlm) (3.22) 


where vn) is determined by (3.16). 


Proof. By (3.21) we have 


8 
WÉINI) = c-Eow(N(m,k),Z(m,k)), k€EK(m), 
so that (3.22) is a conclusion of Lemma 3.2.2.0 


Under the conditions of this theorem expectation values of a func- 
tion w depending only on Z(m,k) can be obtained as a solution of a 
System of linear equations. Corresponding examples are considered 
in Sections 3.3 and 3.4. For those cases where Theorem 3.2.1 can 

not be applied Lemma 3.2.2 can be modified as follows. According to 
Lemma 3.2.2 vector W(m) can be computed if vector Wry (m) is known. 
If for the computation of Wray cm) again Lemma 3.2.2 is used and if 
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we proceed in this manner we will obtain a sequence of recursion 
formulas. In doing this we still introduce the following Notations, 


Wor) (m) = Egw(rg,+N(mk),Z(mk)), ret, (m,k)eM, 060, 
+ H 
Bouts ` (wir) vinllkegia? 


+ "ge i +9 + 
oP ey (men) = > w(rg,+n,g ok “g,(m+n))cy.(m), "ongf. nert, 
k'EK(m+n) ERC 


Lemma 3.2.3. Suppose that Lemma 3.2.1 holds. Then we have for 
EE 
ros J i ee 


(DI Wey (m) = Helm) + C%msmeg, ) "ram. (3.23) 
ð -0 8 +1 > 

(1i) m + (c%(m,meg, 11? "ale, 
j=1 (3.24) 

(iti) Wem) = 2 tm)? MENGE (3.25) 


Proof, Applying Lemma 3.2.2 to w(rg,+n,z) we obtain (3.23), 
Relation (3.24) is a conclusion of (3.23), Finally, (3.25) holds 
since we(m) is an expectation value. I 


The computation of wd? according to Lemma 3.2.2, Theorem 3.2.1 
or Lemma 3.2.3 requires the knowledge of transition matrix 
c°(m,meg,) for mef* as well as of transition vector ©, .(m.n+n) for 
k'e K(m+n), mer’, nef", Since sequence AT is assumed to be 
a sequence of i.i.d. random variables we may state the following. 


Lemma 3,2,4. Suppose that Lemma 3.2.2 holds. 
CET, 


(i) For ns 142,666,494 we have 
9 n-1 
C’(m,m+n) = | C®(n+3j ,m+j+1) (3.26) 
j=0 


where the elements of c°(m+j ,m+j+1) are determined by 
OG , 
Chics (m+j,m+j+1) = Po(X, = k' = k) (3427) 


for KEK(m+j) and k'€ K(m+j+1). 
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(id) For n = 1,2,...194 and kre K(m+n) we have 
ÈP. (m, men) = CP (m,m+n-1) ©. (m+n-1,m+n) (3.28) 


where c°(m,m+n-1) is given by (3.26), where c°(m,m) = E and the ele- 
ments of c,.(m+n-1,m+n) are determined by 


=] 
Cu. (m+n-1,m+n) = P(X, = ki - ki (3.29) 


for ke K(m+n-1). 


Pp roof. Since the de Änn are assumed to be integer-valued 
random variables this lemma follows immediately from the definition 


of transition probabilities ey. (mmen). i 


That means we may parallel are vectors ees .(m,m+n) forn = 1,... 
g, to the computation of ch (m, m+g, ) by means of i a multiplica- 
paum Since the one-step transition orobabilities iR ‚(m+j ,m+j+1) 
and Bun (m+n-1,m+n) can be reduced directly to single probabilities 
of random variable X, it is quite easy to generate the needed vec- 
tors ce ‚(m+n-1,m+n) and matrices C9(m+j,m+j+1). This effects that 
the amount of numerical calculations to obtain this quantities is 
comparatively small. Please note that on the other hand the amount 
of numerical calculations depends essentially on dimension d of vec- 


tor W(m). We obtain in case of (3.14) 


d(m) = card K(m) 


9 9 g 
= card {ker : Ze Ing, 80 acc Aë In A + 2 m}. (3.30) 
91 Yo 94 1 Teo 94 


An approximation for d may be obtained by means of WALO's approxi- 
mations for B and A. To given probabilities «x and B, O<a,ß<1, 
x+ Bei, for an error of first an second kind,respectively, we ob- 


tain 1-8 
In — g Int g 
d(m) *d°(m) = cardfker: ee er + —a<ckc— = + =n 
94 Yo 94 94 Yo 94 
(3.31) 


3.3 The power function 


We consider the computation of the power function of test T(m,k) by 
means of the method developed in the previous section. Additionally 


we introduce the following notations: 


NI - the probability of acceptance of H, by test T(m,k), 
(m,k)EM, ee; 


«te 8 
m (a) = e ke K(m)’ (3.32) 


re(m,men) - the probability of acceptance of H. by test T(m,k) 
on nth sampling stage, ner’, kEK(m), GEO; 


?°(m,m+n) a frecmamen hc rei: 
Then we obtain the following assertion. 


Theorem 3.3.1. Suppose that Lemma 3.2.2 holds. Then for every 


ner, we have 


94 
(E - C°(m,meg,)) Biel = 3 #9(m,men) (3.33) 
n=1 
with 
?°(m,m+n) = c°(m,m+n-1) ?°(m+n-1,m+n) (3.34) 
and o (1) 
r (m+n-1,m+n) = Po(X,> k (m+n)-k) (3.35) 


forn = 1,...,9, and k€ K(m+n-1). 


Proof. By the definition of wini for every k€ K(m) we have 
8 ' 
em) = EQX {s(m,k)> klt) (mon(m,k) )} 


s ef (Z(m,k)> 94k") (meN(m,k))-g (meN(m,k) )} e 
Hence, function w of Lemma 3.2.2 or Theorem 3.2.1 is given by 
+ 

w(n,z) “X {z> g,k(1) (men) z g,(m+n) } è (nz)EeE rxt. 
By (3.14) we obtain 

KCT) (meneg, ) = k1) imen) + go’ nef 
This implies 

w(n+g,,z) "Kir, a4(k‘*) (men)+q,)-9, (meneg, )} 


= w(n,z) 


so that Theorem 3.2.1 can be applied. This implies (3.22) with c = 1s 
We consider the right-hand side of (3.22). For k €K(m) we have 


91 
v2(m) = ae it o X 
i 2 BR: SE {94k'-3,(men)>g,k (4) (aen)-9,(*") 


94 
> 2 ekk (mmen) Key, Kran?) 


n=1 k'€K(m+n) 


91 
= 
= >. > Sk (m,m+n-1) 2 Cen, (men-1,men) 
n=1 k"EK(m+n-1) > k 62) (men) 
G4 l 
= > >_ Geld men-1) Po(k"+X,? klt) (men)) 
n=1 k"CK(m+n-1) 
91 
= > > c® (m,m+n-1) r° (m+n-1 
kk” N k” n- men) e 
n=1 k"EK(m+n-1) 
This implies 
34 
39m) = S_c°(m,m+n-1) 7° (m+n-1,n+n) 
n=1 
for n= 1,...194 and, together with Theorem 3.2.1, (3.34) and (3.35). 
this completes the proof . W 


we remark that according to Lemma 3.2.1 relation (3.34) can be writ- 


ten also as 
n-2 


7°(m,m+n) = TTe®n+3.m+3+2) 7° (m+n-1,n+n) 


j=0 
That means that the right-hand side of (3.33) can 


he computation of c'm, meg). If we 


(3.36) 


for n = 2,...,194° 
be again computed parallel to t 


are interested in the power function M(@) of (N, ó ) e AL o oi 
d. wk, 


BA) ent we have to compute the power function of T(0,0). If 


Theorem 3.3.1 holds we have 
M(@) = SCH ge Gi. (3.37) 


In an analogous manner we are able to compute the operating charac- 


teristic function of T(m,k). Denote by 
ap (m) - the probability of the acceptance of Ho by test T(m,k), 
(m,k) EM, GEO; 


acm) = fakke Kim)‘ 


ap (mmen) - the probability of acceptance of H by test T(m,k) 
on the wë sampling stage, net, ke K(m), ee; 


(3.38) 


Ste. men) = (an (m ,mn))ge Kim)’ 


Then the following theorem holds. 
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Theorem 3.3.2. Suppose that Lemma 3.2.2 holds. Then, for ever 
— Dt -0 y 


men”, we have 91 
(E - C°(m,meg,)) Alm) = 3 B°(m,men) (3.39) 
n=1 
with 
2°(m,men) = c®(m,m+n-1) 3° (m+n-1,n+n) (2.40) 
and 
ap (m+n-1,men) = Po(X,< kO) (men)-k) (2.41) 


for n = 1,...,9, and ke K(m+n-1). 


The computation of the power function and the operating characteri- 
stic function according to Theorem 3.3.1 and 3.3.2, respectively, 
by solving systems of linear equations requires that ratio Gët 
is rational. If this assumption is not fulfilled we may obtain two- 
sided bounds for the power function of test (N, éi ={t, 4 ‚8 ‚B 
A) nept tf we proceed as follows. oa 


Let 95: ÞE go. and bé be integers so that 


9. Yo. Be 
< = E së á (3.42) 
I D gu 
9,70 and g > 0. Let M be the continuation region defined by 
* % 
H g 
* + al In B o In A 
=4(n,k)eEF xP: n <k<—n + Se 
wider, ge ty g Ti 


and, according to the Definition 3.2.1, let T*(m,k) be for this con- 
tinuation region a WLRT for H. H = 8, against H,: @ = 8, with start 
point (m, k)EM*. Denote by my O(m) the power function of T’(n;k); In 


an analogous manner CR the given integers 9. “* and 94 we define a 


continuation region d “and tests Tim k) wath power function 
mi” O(m) for (m, er? M* . Then, since Jo e ch 95° and 94 
power functions my ® (m) for (m,k)e H and m.” (m) for d klen" can 


be computed applying Theorem 3.3.1. By (3. de we obtain 


** are integers 


ch n, B < Žo ne wn By Jo ln B 

H Yı N a g Y 
and Ap M ger 

SCH InA ¢-2n 4 ln Aç -Qn + ln A 

94 Zu n yı 9 "ei 


for every nech" and the acceptance of H, by T**(0,0) implies the 
acceptance of H, by (N,d)- This further implies the acceptance of 


H, by T*(0,0), Then, for the power function M(@) of (N, ) we obtain 
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m. (0) < M(8) < m °(0), oc A. 


An analogous assertion can be obtained for the operating characteri- 
stic function. 


3,4 The moments of the sample size 


we consider the computation of the moments of the sample size of 


test T(m,k) by means of the method of Section 3.3. We still intro- 
duce the following notations. 


en „(m) = EQN’ (m,k) - the pth moment of sample size N(m,k) of 
test T(m,k), (m,k)EM, BED, rev’; 


+ gS 
rei fe, visibke K(m)° 


Theorem 3.4.1. Suppose that Lemma 3.2.2 holds where DEX, > 0. 
Then for every rer we have i 
91 
(E - c°(m,m+g,)) f(m) = S 0" (a°(m,men) + 79 (m,n+n)) 
n=1 
r-1 
-j 9 Q 
+ 21) Jc (m,m+g,) Ke (3.43) 
j=0 


where 3° (m,m+n) and r°(m,m+n) are determined by (3.40) and (3.34), 
respectively. 


Proof. Assumption Dex, > O provides EQN’ (m,k)< co for every rem. 
Applying Lemma 3.2.3 we have 


w(n,z) = n”, (n,zZJEFX<T, 


and we obtain 


94 
ve (m) = Kä 2 n" gv, (ms men) 
n=1 k'cK(m+n) 


94 


= > n” (aP (mmen) + rom, men) ) (3.44) 
n=1 


for k@K(m). Furthermore, we have 


wa) vin = Eo(g, + N(m,k))" 


r 


e > UG) Eet! (m,k) 
j=0 
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r-1 


- 8 @ 
= D (RT ep lm) + er lm (3.45) 
j=0 
for k€K(m). Then, by Lemma 3.2.2, (3.16) and (3.45), we obtain 
(3.43). M 


To illustrate this theorem we consider the computation of the first 


and second moment of sample size of test T(m,k). 


Corollary 3.4.1. Suppose that Theorem 3.4.1 holds. Then we 


have 94 
(i) (E - C%(m,meg,)) 89m) = > n(89(m,men) + F9(m,msn)) 
n=1 ap 
+ 94C%(m.meg,) È, (3.46) 
94 
(ii) (E - C°(m,m+g,)) So(m) = 3 1°(8°(m,men) + 7°(m,m+n)) 
n=1 


+ ner (m, m+g,) i+ 2g,c° (m, m+g,) il, e 


> 
where 1 = SE K(m)° 
That means that based on Theorem 3.4.1 we may compute successively, 


beginning with ur. sample sizes ei Km) for k€K(m), the moments 


of sample size ai (m), d KM)... for kE K(m). In doing this, we 


have step by step to solve systems of linear equations which differ 
only in their right-hand sides. If we are again interested in the 


r + 
moments of sample size EQN ; PET of test (N,6) WEN 


+ we have to compute the corresponding moments of the sample 


aler 
If Theorem 3.4.1 holds we have 


size of test T(0,0). 


r 8 
EN = ge oli, get, 


3,5 The distribution of the sample size 


In view of a truncation of a WLRT the distribution of the sample 
Here we will consider the com- 


size will play a significant role. 
. Denote 


putation of the distribution of sample size of test T(m,k) 


by 
(3.48) 


pe(mn) = Po(N(m,k) zn), ner*, 
the probability that test T(m,k) terminates on sampling stage n, 


(mk)EmM, CEO. 
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Lemma 3.5.1. Suppose that Lemma 3.2.2 holds. 
(i) For n = 1,2,...,9, we have 


Stern) = C°(m,men-1)(a°(men-1, men) + 79 men-1,men)). (3.49) 
(ii) For n = rg, + e with rert end e = 1,...,94 we have 
3° (aın) = (c°(m,meg,))" Bene). (3.50) 
proof. By the definition of pe(min) we have 
pe(min) = Eg(N(m,k) = n) = EX cure ey any ke kisi: 
so that function w of Lemma 3.2.2 is given by 
w(n',z) "Km S ni: (n',z)E Dat, 
Then by Lemma 3.2.2 we obtain 
94 
p. (min) = > > Xin? a n} cpp (m,men') 
n'=1 ent 
8 
+ > dg LC HCH +N(m,k) = ny! kEK(m). 
k'EK(m+g,) {91 j i 
(i) Suppose n = 1,...,g,: Since N(m,k)} 1 we have X(g,+n(m,k) any" 0. 
Hence, (3.51) yields 


pr (m;n) = 2 cP (mmen) 
k'eK(m+n) 


x > cP (m, men-1)(ap.(m+n-1,men)+r a (men-1 men) ) 
k"€K(m+n-1) 


for kEK(m) which establishes (3.49). 
(ii) Suppose n = 9, + 8, 8 = 1,666,943 Then for n = 1,...,94 we ha- 
ve Zi e SS O. Hence, instead of (3.51) we obtain 


NH) = pe(m:g,+s) 


je) 
= Ck (MTs ef io, aN (m,k) = g,*®) 
k CK(m+g,) 


=D cpp (mmga) giel 
k'EK(m+g,) 


125 


for kEK(m) so that (3.50) holds for r = 1. Repeating this step 


(3.50) can be established for r = 2,5,4.. u 


3.6 Admissible tests 


A test (N, ) for H: @ = 8, against H4: Ə = 0, is said to be ad- 


missible at size (ei B) if as given probabilities ol and & its power 
function M(@) satisfies 


Me.) Sx and M(9,)>1- B. 


In Section 2.4 we have investigated certain possibilities to Pi 


values for stopping bounds B and A of WLRT (N, di =ÄL,, a. ‚a, 
Vent: In general we will obtain an admissible WLRT if 


B = B and A = 1fo. 


in this case B is less and A is greater than necessary as 


Indeed, 
size as small as possible difference 


a rule. In view of a sample 
A - B should be chosen as small as possible. In the sequel we will 


present a procedure which follows this requirement for the class 


of tests considered in Section 4,2% 


Let IN. éis {Ln 0.84" BA} opt be a WLRT for He 


. 8 = 9, based on the sequence of i.i.d. integer- -valued random 


H = 8, against 


H 
variables {X trept: Like in Section 3.2 we suppose that 
n 
+ 
a.o 0, In bao ,o, "N > 3 - Yon, ner”, (3.52) 
o’ 1 o’ 1 i=1 


holds for any given real numbers Y; and ¥,> 0. Further we suppose 


that J 
oO O S 
Yı s 94 i JoJ EF ’ 947 O, (3.53) 
and obtain ñ 
g 
noe, 7 (2 a). nen 
i=1 
and 
n 
1 Z =g 5x - gin ner 
n ,8_,98 1 i o! 
yı oi 1 i=1 


so that random variables (94/81)7n EHNEN nef*, are integer-valued 


random variables. 
+ 
For z,seM., O<z<s, let Ta 


against H,: H = ©; with sample size 


be a further WLRT for H. O = 9, 
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N = inf {n2ı: nd ° 
1s + 2 j 
Z yı ar d (0 dh (3.54) 
and terminal decision rule 
62,5 KE (3.55) 
2 + 2 2 el 
Ya Ne 519508 > 8, N, „< 


Then we have x e 
(N, 962,5) = EE 2) ,exp(F(0-2))} 


and test (N, a el coincides with test (N, Ai if 


B = exp(- Ù z) and As wette er, 
94 94 
Conversely, for z,sef*, z<s, this relation provides values for 
stopping bounds B and A of (N, d ) ={iL ‚B,A + so that 
{ n,@, 8, Iner 


(N, ó ) coincides with GËT DE 

Denote by M, (9). BE, the power function of (N, ands 
for every fixed @€® and ser’ M, „(e) is a non-decreasing func- 
tion in z on {1,2,...,8-1}. Between power functions m. (m) of test 
T(m,k) for (m,k)EM and power functions M;.„(9) of tests Lë defi- 


ned above the following connection consists. 


). Then 


Lemma 3.6.1. Suppose that (N, di e Tt 9 o BAY opt satis- 
7g A 


fies (3.52) and (3.53). Let M be the set of lattice points defined 


by (3.4). Let 8 be an integer given by 


g g 
e = - entier( e In B) - entier(- = ln A). (3.56) 
1 1 


Then, for every (m,k)EM we have 


6 
H. (0) = m(m)> dc) (3.57) 
with 94 
z = k - m - entier( — 1n B). 3.58 
Especially, if (m,k) ¥ (m',k’) we have again 
8 i 
M, (8) = m..(m'), 9 €O. (3.59) 


Proof. Test T, „is characterized by critical inequalities 
b 


94 
De == Z 
% 


+ 
9 *2z< 8 ner , 


nO.» 1 


or 
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n 

+ 
O< 9, Ka? -g,n + z <8, nev, (3.60) 
EN 


respectively. Test T(m,k) ie characterized by critical inequalities 


n 
In B em g g, In A 
90 9o ` , É e ai r+ 
5, len) + e, Yo 2. m+i 94 94 Cé 


Since the her’ are discrete random variables these inequalities 


are equivalent to 


n 
Q ve 
ent ier! — In B) <a, > Xmas = 9,9 + 94K - 9," 
90 R 
<- entier(- F ln A), ner, (3.61) 
o 


We note that (3.53) implies 9/¥o = déet Hence, (3.61) implies 


n 
0< 9; > Xmei -gn+z<s8, net’. (3.52) 
iwi 
where z and s are defined by (3.58) and (3.56), respectively. Com- 
paring (3.60) and (3.62) we obtain (3.57) by means of the 1.1.d.- 
property of {xtaert: The critical inequalities of test T(m',k’) 


cen be written as 


n 
H 
D e ch > Ee: IoMt9qk -90n - entier( T ln B)<s, (3.63) 
i=1 


nef*. By (m,k)%(m',k') and (3.53) we obtain 


Q,k - Ja" = g,k' - a 
This, together with (3.63), (3.58), (3.62) and the 1.1.d.-property 
of (Xnlner*, provides (3.59). 


Hence, the computation of power functions Mz (9) for ze (1.....8-1} 
can be reduced to the computation of power functions wäll for 
(m,k)E M and me{0,1,...,94-1}- We remark that this also holds for 
other characteristics. Moreover, it follows from this lemma, if 

start point (m,k) of T(m,k) varies in M and if we consider the cor- 
responding power functions then we will at most obtain s-1 different 
power functions. That means further that under the assumptions (3.52) 
and (3.53) it will not be possible in general to obtain for every 
pair X and B of given error probabilities an admissible WLRT for 
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i = @ against H,: @ a 
Ho! 9 o 89 1 8, whose power function M(8) satisfies 


M(9,) = X and M(@,) = 1-8. 


The following lemma i elas a way for the computation of the re i 
red power functions me(m). qui- 


Lemma 3.6.2. Suppose that Lemma 3.6.1 holds. Then for m = g,-1 
gr rel we obtain 1" 


H e 
m (m) = r (m,m+1) + C°(m,m+1) m°(m+1) (3.64) 
with | 
e H 
m (g4) = Mm (0) (3.65) 
e 
where m (O) is the solution of the system of linear equations 
94 
(E - c%0,9.)) Gro 79 e 
EP (0) = > (O,n). (3.56) 
n=1 


P roo f. Relation (3.66) is a special case of Theorem 3.3.1. Since 


(O,k)* (gy ek+9,) for every kEK(O) we obtain 
e Q 
m (0) = Mag CP for kEeK(O). 
o 


Repeated application of the formula of total 


This implies (3.65). 
We refer to the 


probability provides recursion formulas (3.64). 


proof of Lemma 3.2.2. 


To obtain an admissible WLRT for Ho: 8 = 8, against H,: O = 0, at 


size (X ,ßB) in case of (3.52) and (3.53) we may now proceed as fol- 
lows. We complete the definition of power function RB ER by 
(6) = O and Re (8) = 1, 9€ &, and compute for a preliminary 
value s the power functions 
= DA ) and H. s(91) for z = 1,...,8-1 
according to Lemma 3.6.1 and Lemma 3.6.2. Since these functions 


are monotonically non-decreasing in z on {0,1,...,9% integers 


z’ and am O<z's s, O<sz"<s, 


will exist so that 


(8,) 21 - B for zrz 
and 
M € A for e € en 


is an admissible test 


If z'< z” then every test T, „with z'¢ ze zi 
This is emphasized 


f r4 =æ E a e D 
or H: © O, against H,: 9 = 0, at size (e Bi 
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i t i 
N Fig.3.1. If z"<z' then an admissible test T, e does not exist for 


the Considered value of s. In view of a sample size as small as pos, 
Sible our aim should be to chooses as small as possible. The smalleg, 
Value of s can be found in case of z'< z" by a successive reduction 
of s or in case of z'> z" by a successive enlargement of 8. A good 
initial value s for s can be obtained by means of the WALD approxi. 


mations B* and AP for B and A. We obtain 


g B 94 1- 8) 
ef = . entier( — ln ) - entier(- Sa In e 
¥1 1-& 


x 
As a rule, the minimum value for s will be less than 8 . 


2” 9 z 
Set of admissible 
values for z 


Fig. 3.1. Design of admissible tests 


3.7 Grouned observation 


Let {xJ ner* be a sequence of i.i.d. random variables with range 
¥ SR and a distribution indexed by a parameter 9c). Suppose 
that the random variables Knlner* can be observed or are observed 
only in a restricted manner as follows. 

Let Zoe ue, Za m21, be a given partition of range £ where 


m 
Vo ZK = X and ¥ 50 ae =Ø for i 4 j, i,j = 0,1,...m 
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we assume that only a sequence of random variables {x} + is ob 
served where %,, is defined by Gate 


x, 3 k if Et, k = O,1,...,m, nef’. (3.67) 


since the (Jr are assumed to be i.i.d. random variables also 
e iX, + are i.i.d. Hence, for the di , 
th { ner istribution of X nent 


e obtain 


W 
Polk) = Po(X, = k) = PQ(X, EX), k= O,1,...,m, ner 


(3.68) 


Such an observation scheme is denoted as grouped observation scheme. 


certain aspects of theses observation schemes are discussed by [23] 
and [59]. 

Now we consider a WLRT for H: 9 = 8, against H,: H: 9, based on 
the sequence Kılner*: We suppose that the distribution of Xi for 
9 = 9, is absolutly continuous w.r.t. distribution of x for 0 = Han 


Then we obtain for the corresponding likelihood ratios 


n Po 1) 
+ 
(CHE = a (x!) ner ` 
iat Po (%) 
and 
n Po (X;) 
(2) i 
D 1 + 
z,,0 KÉ 7 > In (x:) . ner 
i=1 Pe. i 


Thus, to given stopping bounds B and A, O<B<e1<A< oo, we obtain 


a WLRT (N', ils {ti e 0,2 ner’ for Hi: @ = 8, against H,: 


6 a 0, based on {X'} op? where N' and 6' are defined be 


inf{n> 1: LA o o é (B,A)}, if such ann exists, 
Nt o 1 (3.69) 
oo otherwise, 


TE: ae 
' = , ie ek * (3.70) 
{iyo 0,24: N'S } 
o’ 1 
As a rule, an approximate computation of the power function or the 


average sample size of IN, 6‘) by means of the WALD approximations 


will then only be possible for 9 = ®_ and @ = @,. The reason is, 

that the distribution of Xi may posess a structure which does no 
longer allow to apply the approximation methods of Sections 2.1 and 
Zë A 


In the sequel, we will consider a procedure which will allow us to 


obtain a WLRT for H. 8 = 8, against H,: @ = 6, by means of an insig- 
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S + 
nificant modification of test variables Aën DÉI e SO that th 
8 


modified test possesses approximately the same optimality Propertie 
8 


as WLRT (N', 46‘) defined above but whose characteristics, like e 


the power function or the moments of the sample size, can be Obtaingg 


exactly applying the methods of Sections 3.2 to 3.5. An additional 
advantage of the concept of grouped observation in connection wit} 
the subsequent method of the computation of the characteristics will 


be that a treatment of certain test problems will be possible Which 


can not be solved using the framework of the usual parametric test 


theory. 
We turn again to test (N',6'). 
as follows. Let e, and c,7 0 be given real numbers and let Yp be a 


random variable defined by 


This test can be characterized also 


i Po, (Xn) ` 
Y,= $ (Inm + d , ne". (3.71) 
1 Pg (Xh) 
o 
Then we have 
r Pa, (K) 
Pal Yn a 3 (an + Co ) = Bel Ba © x): k = O,1,...,m, 
1 Pg (k) 
o 
and 
, + 
“1,0 en urn, , ner, 
i=1 


eo that test IN, déi can be regarded also as a WLRT for Hj: 9 = ©, 


against H,:9 = 8, based on sequence fen? where test variables 
have formally the same structure like the test variables 


n,@ bp 
Ze 9 "6 1 in Section 3.1. Hence, critical inequalities 
da: aa | 
' + 
PRS Mer ii A, ner, 


of test (N', 6') can be written as 


n 
c c 
nB 2n Dy, < 24+ 2n, aert. 
“4 c1 i=1 SE 5 
and we obtain 
fs ë 
i y1: > In B o Ina P if such 
inf{n> 1: tl : + — n, n ar, an n exi’ 
= c 
FS , otherwise, 


N ' 
‘=X c e . 
H 5Y > ln A, "e T (3.73) 
i Cy c ‘ 
i=1 


L 


In this form test (N', &') possesses a structure which may be com- 
_ pared with that of the tests considered in Section 3.1. If, moreover, 
the random variables rer are integer-valued random variables 

we may compute the characteristics of (N',6& ') by means of the 

method introduced in Sections 3.2 to 3.4. 

since C4 is an arbitrary positive constant we may choose this con- 
etant sufficiently small so that random variables LY Thep can be 


approximated by integer-valued random variables 


Y, = entier(Y, + 0.5), ner*, 


Then we obtain a test (N, 6) with 


n 
_ c & if such an 
inf{n> 1: > ¥,¢(4 B + = nae a + = li, n exists, 
i=1 1 a (3.74) 


n 
1 
oo , otherwise, 


and 
(3.75) 


De Ta HR n oe 
n A co 7 
Y,> ETGEN 
(> i Cy Cy 
This approximation for (N', Ari is the better the smaller Cy is cho- 
sen. Moreover, we may choose integers g5 and 94 + O so that 


c g 
= yw 2. 
1 91 


Hence, test (N, 8) can be further approximated by test (N, 6) defi- 


ned by 
n 
= +/90 17 g Jo INA 9 if such 
inf{ny1: Sye — +20, SÉ di Wie 
SS , otherwise, (3.76) 
and 
up. g, INA g ai i (3.77) 
Y,? Seen nice) 
i=1 1 0 d 


The characteristics of this test can be computed by means of the 
method of Section 3.2. If, for instance, we are interested in the 
Power function of (N, S) we have to solve a system of linear equa- 
tions of dimension 


133 


g ln B In A 
d(m) = card {kets i + fat a + a}. (3.78) 
94% 9 91% Žž 91 


Again 
an an approximation for d can be obtained by means of the WALD 

r 
Proximations for B and A. To given probabilities e and B, 0<,B 


< 
1, X+ B<1, for an error of first and second kind, respectively, 
we obtain 


g inf g TEE 
x fe) 1-& g O x g 
c c ) 
91°o 94 91% 9 


Example 3.7.1 The sequential sign test. Let {x ner? be a 
sequence of i.i.d. random variables having an unknown distribution. 


For any given x' €(-00,+00) parameter 0 let be defined by 
P(X,< x') = 0. 
Then @ ranges in LAIF It is desired to discriminate between hypo- 


theses 
H. P(X, <x") = 9, and Hu P(X,<x') = O° (3.80) 


o<e,<9,<1. Such a problem is called a non-parametric location 
problem. It may arise, for instance, if a manufacturer is required 
to have his items exceed a given minimum value - such as life time - 
without knowing their true distribution. To construct a WLRT for 
(3.80) we choose. 


X, = [x',20) and %, = (ex) 
and according to (3.67) we obtain 
sp if CHEN 00) 


and 
K 1 if xE kee F 


nert. For the distribution of x, this implies 
Pg(0) = Pay; = 0) = P(x,e[x',o)) = 1-0 
and 
Pg(1) = Pol Su = 1) = P(X, € Legal = @ 
or 
P(x) = EI: o)1*, xe {0,1} 
so that the {X faert are i.i.d. Bernoulli variables with parameter 
8 and a WLRT for (3.80) based on {x Inept can be obtained in preci- 


sely the same way as in Example 2.1.0 (i). 


A special version of this problem arises if we are interested in 


testing whether the median of the distribution of X, is 2x or < x'e 
Then instead of (3.80) we may use the hypotheses 
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Ho: P(X,<x') = 8 x S sE and H 


o" 4: P(X,<x') = @ 


1 


for any given £, O<t<1/2. Then we may imagine that any observation 
K with EE materializes a positive sign, and a negative sign if 
De <x' 

Now we a demonstrate that we will obtain the same test if we 


proceed as pointed out above. To given Co and c,7 0 by (3.71) we 


obtain 
9. vin 71 - 0.\17"%n 
ye = id( ei (=) er* 
n P ER 1-0, P Sale © è 


If we choose 


1 - 0, o (1 - 9) 
i a- and c4 = ta OT = By) 


we obtain Y, = Xh’ nët", so that Y, is an integer-valued random 
variable and test(N', 6‘) given by (3.72) and (3.73) is identical 
with the test obtained by Example 2.1.0 (i). If, moreover, 

Co 1 - H, dr we 9, ) 

<== ln 

1 1 - 9, 

is a rational number chen we may compute the characteristics of 
(N', 6°) by means of the method of Section 3.2. t 
+ be a sequence of i.i.d. random 


Example 4.748: Leg {X iner 


variables having a normal distribution with unknown mean ® and 


variance 6° = 0.01. It is desired to discriminate between 


Bot Ra Rx a O and H. Ə = 9, = 0.1 (3.82) 
for a grouped observation scheme Bt ZE by the partition 


Ba 8 (-%9,-0.05), ¥ = [-0.05,0.05) and X, = [0.05,+00) 


of range X= R1 of di i oner", Table 3.7.1 presents the distributions 


of random variable x" given by (3.67) and (3. 68) for O = 8, and 
© = O, as well as hie values of likelihood ratio ln (Po, (xe n)/Po_ (Xi ))- 


Po (k) 0.3085 0.3830 0.3085 
O 


Po, (K) 0.0668 0.2417 0.6915 


ln(Po (K)/Pe (k))|-1.5300 -0.4603 0.8071 
(e) 


Table 3.7.1. Distribution of x, 
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If we choose 
Co F 1.5300 and Cc, * 0.2138 


then random variable Yn! ner’, defined by (3.71) takes on the 


values 
O, 5.0032 and 10.9312. 


This random variable can be approximated by random variable Yai ner? 
which takes on the values 


0, 5 and 11. 


Based on the sequence {Ya nert we obtain a test (N, 46) for (3.82) 


where N and are defined by (3.74) and (3.75), respectively. In 
view of the computation of the characteristics of this test ratio 


eh plays a role. We have 


Co 
Fees R 7.1529. 
i 


c g 
If we choose = 7 and = 1 then we have en, ER wë and we may com- 
Io 91 ch 94 


= = = = 
pute the characteristics of test (N, ó) for (3.82) where N and 4 
are defined by (3.76) and (3.77), respectively, applying the method 


of Section 3.2. To assess the amount of numerical computation we 


may consider the dimension of vector Wm). For instance, if we 
= 27 by (3.79) E 


choose “= 0.05, R = 0.05 and m = O we obtain d*(0) = 


Further possibilities of an application of this method are tests for 
a discrimination between two distributions which belong to different 
parameter families. For instance, we can obtain tests for a discri- 
mination between a normal and Cauchy distribution or a geometrical 
and a Poisson distribution. Moreover, we may consider hypotheses 
concerning mixed distributions for which corresponding tests are 
hardly known. A further advantage of our sequential method in com- 
parison with its fixed sample size counterpart is the fact that it 
does not require the knowledge of the distribution of test variable 


n 
KA at sample size n but only the distribution of U which can 


i=1 
be reduced to the distribution of X, Finally, we mention that the 


method considered above can also be used for an approximate compu- 
tation of the characteristics of tests based on a sequence of con- 


tinuous random variables. 
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3.8 Characteristics of truncated tests 


practical reasons it is often desirable to set afinite upper li- 


For 
mit for the number of observations. This leads to truncated sequen- 


efinitiion 3.8.1. To a given WLRT (N,6) = {L o o 


D 
Alne rt a test (N, H ) is said to be a truncated WLRT if to dr 
sep" and C, B<C¥<A, sample size N and terminal decision rule d are 
deet by 

= min {nN} (3.83) 
and 


ó TX {ty 9 ,0,? A, NCA}? "Das, ai REH (3.84) 


respectively. 
In this context we will also say WLRT (N,6) = Uno .o,®’Alner* 


is truncated on stage n with the rejection number C. Like in Section 


3,2 we will now reduce the computation of the characteristics of 
(N,6) to the computation of the characteristics of a truncated test 
of type T(m,k) if Yo/$, = 9,/9, holds. For this reason we introduce 


the following notations. 


N(m,k;n) = min LA,N(m,k)}, (3.85) 
N(m,k;n) 
Z(m,kin) = gy(k + Ò Zeil = 9,[m + N(m,k;ñ)), (3.86) 
i=1 
(m,k)E M. 


Betinition 3.8.2. Suppose that (3.14) holds. To given test 
T(m,k), (m, ReMi test (N(m,k) ‚Sim, k)) is said to be truncated on 


stage n, Der, ‚ with rejection number C, (9, ln B)/%,¢ <(g, In A)/M 


if sample size N(m, k) and terminal decision rule Ö(m, “ are given 


by - 
N(m,k) = N(m,k;n) and (3.87) 


m, k) = X 
{Z(m,k; Bis = ln A,N(m, ien rlrzte, k;n)2&,N(m,k)=n], (3.88) 
respectively. We denote this test by T(m,k;n,c). 


W 
ge will now consider the computation of the characteristics of test 
(m,k;n,c) which can be represented as expectation value 
Egw(N(m,k;n),Z(m,k;n)), GEM, 


f 
OF any given function vil Te, rt. 
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in the characteristic E w(N, Lz ) of test 8 T 
geg ° Teo dëi et (N.S) can be p 


garded as 8 characteristic of a certain T(m,k:n,c) 14 
g g oe namely, 
Zo = ii r n Li and CG = eu ln C 
Yı 94 Zi (3.89, 


holds, then we have 


Eow(N, LA ) = Egw(N(0,0;7) ,exp(—t r 
emlN no 9, el Ni d 9.011. 960. 


In this context we refer to Section 3.2, Then, supposing tr t 
Nng lat t 
corresponding expectation values exist we have the following i he 
f -amma , 


Lemma 3.8.1. Suppose that (3.14) holds. Then for every paj 
\ air 


(m,k),(m',k') EM with (m,k)® (m',k') we have 


Egn(N(m,kin),z(m,.kin)) = Esw(N(mik'iä),z(mik;n)), 06 ©, 
Proof. This lemma can be proved like Lemma 3.2.1.8 


Sy means of this lemma we can obtain a recursion formula for the 
computation of Eqw(N(m,k;n),Z(m,kin)) as follows. To given test 
T{m,k;n,c) and given function w: KIT we still introduce sub- 


seauent notations: 


me (mii) = Egm(N(m,k;n),Z(m,k;n)) 
Sep) = Èw) Yke vie 

Wea) incl = Egw(g, + N(m,k;ñ),Z(m,k;ñ)) 
ay (ma) = {wea kke Kim) 


for (m,k) €M, ner, and 9€ ©. In view of the other notations used 


in this section we refer to Section 3.2. 


Lemma 3.8.2. Suppose that (3.14) holds. If n>g, then we have 


Stan) = ve (m) + c°(m,m+g,) Wey) (msn - 9,) (3.90) 
with 94 
SIS ‚ai 
Pe Jimeno = sde Sie 00 
nei k'EK(m+n) 
for every ac and 0€ ©. 
ystem 


of Lemma 3.2.2 we consider the $ 


Proof. Like in the proof se mutually 


i 
of events (3.17) which forms a complete system of pairw 
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i 290 e 
and exclusive events. Term v (m) in (3.90) is obtained like at Lem- 
ma 3.2.2 and for sum s, given by (3.19) we obtain here 


(0) 
H 


= N Taj io 

| > ow(N(m,k;n),Z(m,k;n)) | Cpp: (mım+g,)) 

k EK(m+g,) ep 
ok (mım+g,)), keK(m). 

Since n>g, we further obtain 


Polk: (mım+g,)) e og (mımg,). kEK(m). 


The 1.1.d.-property of NEI (m,k)=Z(m+g,,k') for k' = ktg, 
and Lemma 3.8.1 imply 


Eg(W(N(m, k:n), Z(m,k:ñ)) | Cpp: (m,m+g,)) 
= Eow(g, + N(m+g, ,k+g, :-g,) .Z(m+g,,k+g, :N-g4)) 
= Egw(g, + N(m,k;n-g,),Z(m,kin-g,)) 
= A1 ,v(miR-g,) 
for kE K(m). This completes the proof. W 


This lemma can be used, for instance, to obtain recursion formulas 
for the power function or the moments of the sample size of a trun- 
cated WLRT. We consider the power function of T(m,k;n,c). Denote 

by n.(m:n,c) the power function of test T(m,k:n,E), kEK(m), mer’ 
and 0 € Ir where 


me (m;n,E) = eiinrë, EI, e Kim)‘ 


Lemma 3.8.3. Suppose that (3.14) holds. Then for every t = 
1,2,... we have 


91 

0 = 20 (2) +0 - 

m (m;tg,,C) = Fr (m,m+n) + C (m,m+g,) m (m;(t-1)g e) ` 

(mitg,.C) 2. ( ) 1 1'° (3,92) 
n=1 
with the initial condition 

4 for g,k - q,n>C€ 

mo(m;0,c) zi 1 aa (3.93) 
O for Ok: gaz 


where PO immen) is determined by (3.34). 
Proof. For every ner, k €K(m) and oe) we have 


mo(min,c) = Eow(N(m,kin),Z(m.kin)) 
with 
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win, zi “X rza} for (n,z)ef’xr. 


Applying Lemma 3.8.2 we obtain 


94 
S +8 H 
m°(m;tg, ‚©) = >? (m,m+n) + C°(m,m+g, ) VIDE Sr 
= e 
n 1 (3.94) 


Get rOin, men) is given by (3.34). Function w above satisfies 


(naz)e fixr. 


w(n+g, .Z) = w(n,z) for 


This implies 
"aylmilt-1)9,,0) = Wlmi(t-1)g,,0) 
= A (mi(t-1)g,.,0). 


This, together with (3.94), SET E (3.92). The initial Condition 
(3.93) is clear because of m im; O,¢) is per definition the Dower 
function of T(m,k;0, ei hoch" is a test with sample size N(m,k;0)=0M 


If we are interested in the power function M(9), 0e ®©, of WLRT 
(N,d) = e e. 8.7 ‚a Ale tg which is truncated on Stage n = tg, 


with rejection "morba C, BEC <A, then under the conditions of this 


lemma we obtain 


M(@) = SCHEN Inc), ee®. 


Ifn= tg, holds for any given ten” our lemma shows further that 


the corresponding power functions Gë be obtained directly by the 


gege of iteration. Formally, the computation of the power function 


win: SÉ? of test T(m,k; AT according to Lemma 3.8.3 is adequa- 
te to the solution of the system of linear equations (3.33) by the 


method of iteration ans the initial condition (3.93). In this 


Ə 
sense we can regard me(m; tg, .c) as the t approximation for m(m), 


k€ K(m), 

Considering test T(m,k;tg, .c) we suppose that the upper limit of 
observations n is an integer multiple of 9]. In situations where 
this assumption is not true we may compute the power function of 


T(m,k;n,c) as follows. Let s be an integer where 


n= tg, + 8, ter? Ors<g,. 


Then in an analogous manner we obtain 
s-1 a 
Trans, EI = > F°(m,m+n) + 7° (m,m+s) (3.9 


n=1 


with 
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#9 a a 
re (m,m+s) > Cup (m,m+n-1) Pu(g,(k'+Xd-g,(m+8)> ©) 
k'EK(m+s-1) 
as the probability of acceptance of H, by T(m,k;s,c) on the sth samp- 
ling stage. Substituting initial condition (3.93) by (3.95) we may 


>08 e ap 
compute M (m;n,c) according to Lemma 3.8.3 by the method of itera- 


tion again. 
we now consider the moments of the sample size of a truncated WLRT. 
Again the computation of theses moments is reduced to the computa- 
tion of moments of the sample size of certain tests T(m,k;n,c). 
Denote by 
e° (min) = ELNT(m,k;n) 
a baii H gëff 
the DA moment of sample size of test T(m,k;n,c), (m,k)EeM, nern; 
+ =@ en 8 e 
ee ©, rel,» Her Se e (m:n) ={er „(min)}nert We remark that 
rejection number © does not play any role here. 


3.8.4. Suppose that (3.14) holds. Then for every rer, 


Lemma 
end t = 1,2,... we have 
94 
DNR = > af (3° (m,m+n) + 7°(m,m+n)) 
n=1 
r-1 
- B 
+ c°(m,m+g,) Se Í s e,(m;(t-1)g,) 
s=0 
+ c°(m,m+g,) @2(m:(t-1)94) (3.96) 
with initial conditions 
for s e 1,«ss,f 
(3.97) 


for e = O 


el OF 


Siten = | 


where 3° mmen) and F9(m,m+n) are determined by (3.40) and (3,34), 


respectively. 


Proof. The initial conditions (3.97) are evident. Applying Lem- 
ma 3.8.2 to w(n,z) = nl we obtain 
94 
+0 ii 
e.(mitg,) = D 9° (89 (n,men) + F°(m,men)) 
n=1 
0 
+ C (m mega) Weg )(ms(t-1)94) 


where 
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wery kemict-2)94) = E9(9; * N(m,ki(t-1)94))° 


r 
= > () EQN°(m,k 3(t-1)g,) 
get) 
r-1 
8 >) es k(Mi(t-1)94) + er ‚n(ms(t-1)g,) 
e20 


for keK(m). This establishes the Lemma. @ 
r 
e moments EN of sample size of 


re again interested in th 
+ which is truncated on stage n = tg 
1 


If we a 
WLRT (N, ó ) e It (=) ‚o,®Alner 
To 


then we obtain 


Q 
EQNT = ep aigle fr teese: 
of Lemma 3.8.4. If instead of n = tg, we have 


under the conditions 
s,tem*, we may compute the moments of sample 


n= tg 
i 
k:,é) in a similar manner like we have done it for 


size of test T(m, 


the power function. 
We remark that in case of r = 4 we have formally the same situation 
in comparison with the computation of the power function of a trun- 


cated test. Under the conditions of Lemma 3.8.4 for r = 1 we obtain 


94 
GIE = S_0(8°(m,men) + T°(m,men)) 
n=1 
+ ol m,n+g,)g, 2 + C°(m,meg,) 3° (mi(t-1)g,) 
for t = 1,2,... with (3.98) 
(3.99) 


Det H = Ò. 


nents, the computation of the average sample size of test T(m,k; 
SE according to Lemma 3.8.4 is adequate to the solution of the 
m | 
gece linear equations (3.46) by the method of iteration using 
= Ber condition (3.99). For r}2 we can not interprete relation 

-96) in this sense since the needed terms 3°(m;(t-1) ) depend on 
t and on each iterati E o ` 

on stage we obtain r iteration formulae which 


are linked together. 
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3.9 A_continuous inspection scheme 


We consider a sequence (S hepi of i.i.d. random variables having 

a distribution depending on parameter 9 €@. We suppose that a para- 
meter change can take place at a random time point TEL” go that 
the distribution of Busser and Xrya'*%tagesee Is characterized by 
parameter wë ®© and HE Ob wi + 9,» respectively. Our aim is to 
detect this parameter change as soon as possible by observing the 
sequence (X Inent*: Sampling schemes for this task are called con- 
tinuous inspection schemes (CIS). Beginning with DODGES's [25] samp- 
ling inspection plans a lot of CISs has been created and a certain 
survey on these sampling schemes has been given by BOWKER [17]. 

The optimum property of WALD e likelihood ratio test emphasizes to 
use repeated WLRTs to detect a parameter change. Such an approach 
has been considered by PAGE [61] ,[62] and EWAN, KEMP [32]. The pro- 
blem which arises in this context is the computation of the charac- 
teristics of such sampling schemes. Applying the framework of Sec- 
tions 3.2 to 3.4 we will present an new method for the computation 
of the moments of the so-called run length of a CIS which is given 
by a sequence of WLRTs based on discrete random variables. The CIS 
under consideration is defined as follows. 


Let d'Suen? be a sequence of i.i.d. integer-valued random variab- 
les with a distribution depending on a parameter Oc ®©) where at a 
random time point Tef* a parameter change may occur from 9 = 9 EO 
to @ = @.€@®. To detect this parameter change we consider WLRT 
(N,d) = {In,e_.e,'®’Aner* where we suppose that 


n 

+ 

-y 2% 7 Yor nen”, 
i=1 


= ln La 


1 8,8 


1 
¥,? 0, holds. Denote by M the continuation region of (N, å ) given 
by (3.4), then for every (m,k)€M a CIS can be defined in the fol- 
lowing manner. 

(i) We start with test T(m,k) and continue sampling according to 
this test until H. or H, 
(ii) If H, is accepted by T(m,k) the sampling procedure is termina- 
ted and this termination is interpreted as a possible hint to a 
parameter change from 0. to @,. 

(iii) If H, is accepted by T(m,k) on stage N(m,k) = n', n'er*, 
then test T(m,k) does not provide any indication of a parameter 
change from H. to ef and we continue sampling by starting a new 
test T(m,k,) for Ho against H, based on sequence IR: al ker? 


is accepted. 
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wh 
ere ko is a given integer with 


Yo ln B d 
— m + — Ck e hi In A 
V1 Mi dog og 


(iv) If H, is accepted by T 
Se p y (m.ko) then the sampling procedure is 
nated with a hint to a possible parameter change 
(v) If Ho is accepted by T(m,k_) on stage N(m,k,) = n" 
, o Ke D we start a 
urther test T(m,k,) for H. against H, based on {x } 
and proceed like it is formulated by (iv) and bh, RAA 
ure 
is repeated until hypothesis Hy is accepted for the firet time 
We denote such a sampling scheme by CIS(m,k,k,). ) 
o 


The interesting quantity of this CIS ie the number of observations 
until the first decision for HA, We shall call it the run length 
of CIS(m,k,k.) and denote it by als It is evident that for 


any given © e ® for which the probability walk, of acceptance of 


H. by test T(m,k,) is non-zero we have 


Polt, (mk) < oo) = 1. 
D 


That means that CIS(m,k.k,) terminates with probability one when- 
ever ma(k,) >0. If @ = H. and if a parameter change does not occur 
the a termination of CIS(m,k,k,) is non-desired and should happen 
as rarely as possible. If otherwise © changes from O, to 9, a ter- 
mination should occur as soon as possible. Hence, the most important 
characteristics assessing the properties of CIS(m,k,k,) are the mo- 
ments of run length. We introduce the following notations. 


Ky (m,k) - random number of tests which are required by CIS(m,k, 
8 ei until the acceptance of H, for the first time; 


nd em,k) - sample size of test T(m,k); 


Nli) emk) - sample size of gen test in the sequence of tests 


according to cIS(m,k,k,): i = Zeie e 


Then we have Ky (m.k) 
Ly (m,k) = N(1)(m,k) + 3 nlt) (mk) 
© i=2 


and the following lemma holds. 


Lemma 3.9.1. Consider CIS(O,k,.Kko)" If 
H T(0,k,))?0 
mo(k,) = P„(Acceptance of Hy by T( ef? 


then we have 
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(4) Polkk (OK) = J) = (2 - me (0))97 m. (0), jer*, (3.100) 
(e) 


and 
EoN(O,k,) 


a? (0) . (3.101) 
O 


(11) Bel, (0.K,) = 


P roo f. Relation (3.100) is an immediate consequence of the de- 
finition of CIS(O,k,,k,). Hence, the number KL (Ok. of tests 
o 


T(0,ko?) until the acceptance of H, for the first time is geometrical- 
ly distributed and we obtain 


H 
CA = 1/n, (0). (3.102) 
Consider "ex (0ko): Then we obtain 


oo 
Pet, (Orko) = 2 Feit (0ko) | Ku (Orko) = Arel (O,K)=3)- 
j=1 ° (3.103) 


Denote by a(t) and p(t) the events of acceptance of H. and H. of AA 


test T(0,k,) of CIS(O,k,.k,): up”. respectively. Since the {x} ent 
are assumed to be i.i.d. random variables we obtain 


SI (O,k.) |K, (O.k_) = 3) 
of ka | KO ko) = J 


J 
= Ee (Säiten NEBEN) 
Lei 


j-1 
> Seit ail: Eolo RO) 
ind 
= (3-1) Eg(N(0,K,) | AT) + EG(N(O,k,) | RO?) 


for every ep", This, together with (3.103), (3.102) and m. (0)> 0, 
o 


implies 
Pet, (01ko) = Eo(NtO.K IAC?) -Egky (Oko) 


- Eg(N(0,k JACI?) + ENCO IRE?) 


` E9(N(0,k,)[AC4)) 


1 (1) 
Wis) - EG(N(O,k )[A't)) + Eucnto,K lei 
oO 
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ER (C1 = mk (09) Eet bell al: mE (0) Eet Miguel säin) 
Oh O 


- EgN(O,K,)/n, (0) 


and the proof is complete. W 


We remark for a correct interpretation of the average run length 
that the farmulae of Lemma 3.9.1 hold for a fixed parameter 9 € ©), 
If, for instence, a parameter change occurs from 9, to 9, at the 
time point T = t and if we have reached by C1S(0,k.,k.) lattice 
point (tk) ENM then the average run length Eg tk (ko) can be in- 


terpreted as follows. If 


ke > kl + Yo ¢ + in B 
o %7 Zi 


Chen Eo bka (O,k wi is an upper bound for the average number of obser- 
wi 


vations ween? termination according to our CIS after the parameter 


change. Especially, if ko is chosen by 


w ln B 
k =k = minikef: k> — 
> { LÉI 

and if further lattice points do not exist with a smaller distance 
to the straight line of acceptance of T(0,k,) than point (Ok 


then average run length Ey Lp«(0,k" ) is a general upper bound for 
1 


the average number of observations until sampling termination after 
the parameter change. 

Lemma 3.9.1 shows that the computation of the average run length of 
CIS(O,k, ‚k at can be reduced to the SE of average sample 
number £ ANE, ko? and power function m. (O) of test T(O,k "E If the 


slope of the straigt line of acceptance of T(0,k,) is rational then 
these quantities can be computed by means of the method presented 

in Sections 3.2 to 3.4. Moreover, for a rational slope it will be 
possible to compute the moments of the run length in a direct manner 
reducing this problem to that of solving of a system of linear equa~ 
tions. We shall demonstrate this possibility here only for the ave- 


rage run length. 


Lemma 3.9.2. Consider CIS(m,k,k_), (m,k)EM, k €E K(m). Suppose 


that 


Zo Jo 
— = — y » r P > 0. 
¥, 7 9,’ oas = 
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then we have 


i 
(E - C°(m,m+g,) - CÊ) Egly (m) 
O 


Hi 
_ 28 26 6 ER 
= n(a (m,m+n) + r (m,m+n)) + g4 © (m,m+g,) 1 (3.104) 
n=1 
with 94 
8 8 > > 
Co = (22 (nınen) ðs onn ) 
EN 
and 


— 
Egby (m) m {Eat (mk) } ce Bé 


where c°(m,m+g, ) is the transition matrix considered in Lemma 3.2.2 
and 3° (m,m+n) and Olm, men) are given by (3.40) and (3.34), respec- 
tively. 

Pr oo f. Denote by A,(m+n) and Ry. (m+n) for kE€K(m) and n = 1,..., 
94 the events of acceptance by T(m,k) on Dä sampling stage, respec- 
tively. Denote by Cu. (m,m+g,) for kEK(m) and k'EK(m+g,) the event 


of reaching lattice point GASTON by T(m,k). Then system 
J1 94 
A, (m+n) » Ry (m+n) Lt .(m,m+g,) } 
{men} 7. (atmen) le, e 


forms a complete system of pairwise mutually and exclusive events. 
The corresponding probabilities of these events have been introduced 
on Sections 3.2 and 3.3. We refer to Lemma 3.2.4, Theorem 3.3.1 and 


Theorem 3.3.2 and obtain 
H 
Po(A,{m+n)) - a,(m,mn), kEK(m), ns 1,...,94. 
2 
Po(R,(m+n)) = r.(m,mn), kKEK(m), n = 1,0..,94: 
8 ' 
PolC,g:(m,m+g,)) = Sg CAE keK(m), k'e K(m+g,)- 
Applying the formula of total probability we obtain 
94 


Egty (mk) D (Gett (mek) | AQ (amen) Jakim men) 
nai 


+ Eg (ty (mek)/R, (men) )re(m,men)) 


+ > Feit (m.k) Cpp (mmg J) Ck: eergn) 


for k€ K(m). kek (megs) (3.105) 
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In particular, according to the definition of CIS(m,k,k,) we obtain 


w 
Bett (mak) |Ak(men)) an+ Eat (Mko) 
for kE K(m) and n = 1,...:93 where Ely, (m.ko) denotes the average 


run length of CIS(m,k.K,) based on sequence {Xmenegtyert: 
Since the {xX bert are assumed to be i.i.d. random variables we 


have 4 
Eobk (m,k,) = Both (m,k,) 
o o 
and therefore 
Bett (mek) [A (men) = n+ Bel, (Mk) for k€K(m),(3.106) 


Further we obtain 


Fett (mek) [R,(men)) =n for kEK(m) and n= 1,...,9, 


(3.107) 


and, in an analogous manner, 


Bette (mek) |Ckk'(mmtg4)) = 9, + Pei, (mea, sk’) (3.108) 


for kEK(m) and k'EK(m+g,). If we put k* = h + PR by the i.i.d.- 
property of {x Iner* and (m,h) > (m+g,.h+g,) for h€& K(m) we obtain 


Eat (mre hb! = gt, (meay Redo) = Egg (ash) (3.109) 


for h€ K(m). Putting together (3.105) to (3.109) we obtain 


94 
G 
Kl = > n( a. (m,men) + re(m,m+n)) 
n=1 | 
Hu 
(2) | 
+ Se, (Mko) > ammen) + 94 > ehr (mmeg) 
n=1 k'eK(m+g,) 


+ > Egl, (m.h) Cehsg (n.m+g,) | 
heK(m) š j 


for kEK(m). Writing these equations in matrix form we obtain 


J1 
— 
"ei (m) = > n(m, men) + POf m, men) ) 
n=1 
94 
+ (> 2°(m.men).5,....8) Eet (m) 
n=1 e 
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G > 
H — EB 
+ dat (m,m+g, ) 1 +C (m,m+g,) Fa, (m) 


and the lemma is established. I 


Formula (3.104) is quite similar to formula (3.46) for the computa 


tion of average sample size Egn(m,k) of T(m,k) for kEK(m) 


e To com- 
pute vector "ex. (m) we again only need elementary matrix operations 


which can be canlewented easely on a computer. The computation of 
the needed quantities for (3.104) can be realized like in Sections 
3.2 and 3.3. In a similar manner we may obtain systems of linear 
equations for higher moments of run length. We present the result 
for the second moment of run length without proof. 


Lemma 3.9.3. Suppose that Lemma 3.9.2 holds. Then we have 


(E - cm GET WW c9) E L2 (m) = 2,29 +8 
"Zi ol "ek = n”(a (m,m+n)+r (m,m+n) ) 
u n=1 


+ 2 Eet. (m,k,) e 3° (m,m+n) 


n=1 


2.9 > : 
+ 94° (m,m+g,) 1 + 29,C(m,m+g,) Fe Za) (3.110) 


with —{3 


2 2 
LÊ (m) = {Etk (mek b ke Kin) 
o o 
where the other quantities are defined like in Lemma 3.9.2. 


In view of an application of our CIS the choice of the stopping 
bounds B and A of the underlying test plays a role. These stopping 
bounds should be chosen in such a manner that the average run length 
"ex (Ko) is large for QO = 8, and small for @ = @,. We shall say 


CIS(m,k_.k,) is valid if to given bounds 1, and l,, o<1,<1, 
the average run length satisfies inequalities 
Pe tk (mika) ® to and Æ Mk, (m,k,)E1l,» (3.111) 


H: 


It is not possible to obtain an explicite formula which provides to 
given bounds lo and l, corresponding values for B and A so that 
CIS(m,k, ek ei is valid An the sense above. Indeed, by means of Lemma 
3.9.1 in be EE with the corresponding WALD approximations of 
test T(m,k,) we may obtain approximations for B and A so that CIS 


(mkoko) is valid in the sense of these approximations. 
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In do i ; 
ing this we consider the particular case CIS(0,0,0). If (N,d) 


isa 
WLRT for H. O = H. against H,: 0 = © with probabilities o 


1° 1 


and 
8 of an error of first and second kind, respectively, we obtain 
Eo M Pa" 
Eo L,(0,0) = and Eg L,(0,0) = Ge? 
o A 1° 1-8 


Hence, & has a much greater influence on average run length than ß. 


Approximating Ey N and Ey N by the corresponding WALD approximations, 
i o 1 
given by (2.229) and (2.230), respectively, we obtain the approxi- 


mations 


(1 - &) In B stin Za 
Eg L (0,0) a (3.112) 
o ° e En Z e 
9, 1,0,8, 
and 
Bing + (1-8) in 25 
Eg L,(0,0) mb T (3.113) 


(1 - B) Eg Z 

8, 1,9591 
By suitable choice of & and ß we may reach that right-hand sides 
of (3.112) and (3.113) satisfy the validity criterion (3.111). For 
these values of o and B we may determine the WALO approximations 
for stopping bounds B and A according to (2.31) by 


ß 1-8 
B = ge and A = = 


These values for B and A can be successively improved by calculating 
average run lengths Ey L,(0,0) and Ey L.(0,0) by means of Lemma 
o 1 


3.9.1 or 3.9.2 and comparing these values with the approximations 
given by the right-hand sides of (3.112) and (3.113). This compari- 
son provides hints how we have to change & and B to obtain a valid 
CIS. 
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4. Discrimination among k> 2 hypotheses 


There are situations where we may be interested in discrimination 
between more than two hypotheses. The optimality properties of the 
WLRT emphasize to use several WLRTs for solving such multiple-decision 
problem. Based on two WLRTs SOBEL, WALD [72] have considered a cor- 
responding procedure for a discrimination among three simple hypo- 
theses concerning the mean of a normal distribution with known 
variance. This so-called Sobel-Wald-test is used by GHOSH [35] for 
discrimination among three hypotheses concerning the parameter of a 
one-parametric exponential family. In comparison with [72] there 

are presented improved upper bounds for the average sample size. In 
view of an improvement of the lower bounds for the average sample 
size, given in [72] ‚ corresponding results were obtained by SIMONS 
[71] . Investigations into a direct computation of the average sam- 
ple size and the power functions of Sobel-Wald-test seem to be un- 
known so far. Other procedures for a discrimination among more than 
two hypotheses which do not correspond to Sobel-Wald-test but use 
sequential tests have been considered by [3].[4].(15].[55] .[5e] . 


[63] ,[70].[71] et al. 

In this section we will consider a version of Sobel-Wald-test for 
discrimination between k, k ?2, simple hypotheses concerning the 
parameter of a one-dimensional exponential family. Let Kai ont be 


a sequence of i.i.d. random variables having density 
1 


fa(x) = h(x) exp(d(@)t(x) - ¢(8)), xeX , 0€(8,0)ER, 
where c and d are strictly monotonical in @ on (9,0), c(9)> O for 
6 € (9,9). Consider the problem of discrimination among hypotheses 
H,: H = 8, H3: H = CIE Hi? H = Ək 
where 


g<ce,<o,<'''<o,<®. (4.1) 


Analogously to SOBEL WALD [72] we consider k-1 WLRTs defined as 
follows. F = 1,...,k-1 let W, be a WLRT (N,, 4.) = AL 

ows. For j et W, a ( 4 j? TT 
P, Auer? for H. 0 = O, against H. H = 9.41 based on stopping 
bounds B, and A, Dep, 1<A,< eo. For the further considerations 
we still suppose that d is increasing in @ on (9,0), then critical 


inequalities 


d'H < Ay, nef" 


bw D 
of w, can be written as 
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n ‘ 
a r + 
hin) < 2%) § baktëie gek 
where hin? and hy(n) are given by 


a a ln Bj 
ha (7) = + Don 


and i 2 
n 
r z mae | 
halad ee Aë 
with 
Aj = dëi - die,) 
and 


LÉI = (e(@,,4) = delt Ya, 
for j= 1,...,k-1 and nef", Since (4.1) we have 
¥1 fad e Ek 


(cf. [35] , Proof of Lemma 5.1). We now suppose that stopping bound 
8 
Bee Be, and A,,++-.A,_, are chosen in such a manner that 


ln B ln B 
Le... £ el 
81 Ax-1 (4.2) 
and 
ln Au ln Ak (4.2) 
E ve E K-i. 
^1 Ak-1 (4.3) 
Then we obtain 
a a a 
h(n) < ho(n)< ss Shy y(n) (4.4) 
and 
(4.5) 


h; (n) < h(n) < -+< hg_4(n) 


for nef", 
By means of (4.4) and (4.5) we reach a compatibility of Wares eM y 


in the sense that,for instance, the acceptance of hypothesis P, 


by test W) implies the acceptance of H,, by test WV for all j'?j. 
Moreover, these conditions will facilitate the evaluation of the 


properties of our test. 

The procedure under consideration is defined as follows: Suppose 

that (4.2) and (4.3) hold. Then based on sequence {X Inert we 

simultaneously realize tests We WA where at every sampling 

Stage n = 1,2,... we take one of the four decisions: 

(i) We accept H, if test W, accepts H,. and DA 
J 


(ii) We accept H, if until this stage H, is accepted by H, 
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Te Gates. 


(iii) We accept 4 


(iv) We otherwise Continue e 


k if test vw accepts H , 


ampling by observing X 


e denote thi Kon 
W 1S procedure by e, Fig. 4.1 illustrates this pr 
for k a 3 where a Possible 9a u 


to acceptance of H 


mpling path is considered which leads 


2 by S, 
nl a 
St (n) Wio 
i=1 
Ha 
H, . 
Kin 
x 
x“ 
x h(n) 
H3 
o 17 S i 
Acceptance of H 


Denote by N the sample size of S and le 
test WI j = 1l,o...,k-1. Then, 


2 


Fig. 4.1. Acceptance and continuation region of S for k = 3 


t N, be the sample size of 
by the definition of S, we have 


N = max (Nu, 4 H, 


This implies 


-1 
NJENC N, j= 1,...,k-1, 


and we obtain 


k-1 
o € (0,0). 
EK) 
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These bounds for EgN are quite useful if the differences are large 


between neighbouring parameters given by hypotheses H,,...,H,. 
Further bounds for EQN are considered by [71] . [72] and [35]. A di- 
rect computation of E,N is a very laborious problem. If S is a pro- 
cedure based on a sequence of integer-valued random variables where 
the underlying tests satisfy the assumptions of Sections 3.3 and 3,4 


then a direct method of the computation of Ech is presented in [29]. 


Consider the computation of the power functions of S. Since by S a 
decision is possible for one of k hypotheses k power functions will 
be of interest. These power functions can be reduced to the power 
functions of underlying tests Wares Was Denote by (J) 9) the 


probability of acceptance of Hy by S, J = Lesen @€(0,@), and de- 
note by Bake) the power function of test Wi j = 1,...,k-1, @ (8,8). 


Lemma 4.1. For every 9€(9,8) the power functions of S satisfy 


the identities 

(1) m'")(9) = 1 - m,(0), 

(ii) ` wilren- My_4(@) - M (9) for I = 2,...,K-1, 
(111) Ma) om (0). 


P roo f. Denote by A, and A, the events of the acceptance of hy- 


pothesis H, and H by test vw respectively, j = 1,...,k-1. Then 


j EA 
Aye Ags SAL. 
and 


ABA: DA 
A,2 A,> Binns 


Hence, for @€(0,0) we obtain 

For j = 2,...,k-1 we obtain 
= Ciel = Po(A,_,) S AL zs M.(0) za (2. = My 468) 
= My 469) - AS) 8 €e (0,0). 

Finally,we obtain 

Ana SÉ 


MCK) co) = P,(A,' t Ak-1) = PolÂk-1) =M_.(8), © € (9,8). 


8 


Based on this lemma we may obtain approximations for villen... 
m(K) 9) if we approximate power functions M(@),...,M, (8) of 
VËLO by the corresponding WALD approximations. Se may obtain 
exact expressions for villen... wiklren if the method of Section 3.3 
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can be used to compute M.(O),...,M._4lP)- Moreover, the identities 
of Lemma 4.1 can be used to obtain approximations for stopping bounds 


‚ser Bulg and Ausser For k = 3 this problem is discussed by 


5, A sequential test for a simultaneous observation of several Ber: 
noulli distributed random variables 


Sequential tests for a simultaneous observation of two different 
Bernoulli distributed random variables on each sampling stage are 
investigated by [1s] .[35] , [37], [44] , [56] , [69] and others. 
Problems of this type may arise in such situations, for instance, 
where we have to decide between two rival manufacturing processes 
or medical treatments. These decision problems can be reduced to 
tests for simple hypotheses. For other aspects we refer to 
BÜHRINGER et al. [19] . 

“ere we will consider the more general case where we may observe on 
each sampling stage an m-dimensional, m22, random vector x = 
Kur Kam): n = 1,2,..., whose components are Bernoulli distri- 
buted random variables. Such a situation is given, for instance, if 
we consider a lot of items where each item is characterized by m se- 
veral quality characteristics. For the further investigations we 
generally assume the following: 


— 
(i) The random vectors E ge gea are stochastically independent and 


identically distributed. 


(ii) The components Kay Kam are stochastically independent Ber- 
noulli distributed random variables with 


x 1- 
Po nk = x) = 0,(1-9,) X for xeflo.ı}. 


e € [0,1], k = 1,...,m and nef*. Then, for the distribution of vec- 
tor x. we obtain 
- x 1-x 
Po(X = x) = | Te, Kis o dä Kner*, 
k=l 


m m 
with 6 = (@,,.--,8,)€© = x (0,1) and x € x CHIF That means, 
=1 kel 


thet under the above assumptions the distribution of vector x, is 
completely determined by parameter vector d. 


Our aim is to obtain a WLRT for testing hypothesis 


Ho: O CO, against Hai 6 eo, (5.1) 
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where O- and @, are given disjoint subsets of ©. we shall later 

discuss conditions restricting the choice of ©, and ©, . In testing 
hypotheses (5.1) we consider a test (N, $) E is datind as fol- 
lows. Let Yo’ Myr cee Ca be given non-zero real numbers, let Z be 


a random variable defined by 


n m 
+ (5.2) 
Z a Lef? ~ Yon’ ner ` 
32 


and let b and a be given stopping bounds, -o<b<O<a<+r®. Then 
sample size N and terminal decision rule á of (N, 6) are defined by 


e ts, 
ye f int (neds Z,€(b,a)}, if such an n exists (5.55 
eg , otherwise, 


and 
d = CH a,N< oo} (5.4) 


respectively. The choice of N and 6 in such a manner is motivated 


by the subsequent example. 


Example 5.1. Consider a WLRT for 
< -p 
Ho: @ = 8, against H,: 6 = 8. (5.5) 


= 


web 
o,€ ©, Di + 84k? k = 1,...,m, based on a sequence bier 
satisfying assumptions (1) and (ii). By the definition of the WLRT 


we have 
ik 
L = CG oi | ) 
(ECH 1-09 
I k=1 o,k 


and 
2388, D D Wie fe 
izi k=l 
with m 1 - e, : 
Yo * 17 ask (5.6) 
ki "Rik 
and 


Yu = AE ok (—— dh sl k = 1,...,7 (5.7) 


nef". H 
ence, we obtain test variables SEHR DEI T , which have 
a structure proposed by (5.2). Moreover, 


if we choose the stopping 
bounds of our WLRT according to 


B= 8 and A = 1/& 
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to given a and B, OCX, B< 1, © + B<1, then test d'A Zu a Aë 

n ,8_,8,' 
BAlner* is an admissible test for (5.5) at size (X ,ß) (cf. Seen 
tion 2.4). m 


conversely, a test (N,d), given by (5.2), (5.3) and (5.4), can be 
regarded as a WLRT for certain simple hypotheses. 


Lemma 5.1. Consider test (N,d ) given by (5.2), (5.3) and (5.4). 
cor k = 1,...,m let H. kv and © be defined by 


1,k 
Bak" (1 ~ exP($o,k))/(1 - exp(¥,)) (5.8) 
and 
Os ok = Ha k exp(¥),)/exe(y, vi (5.9) 
where e 
fe = Za k and Yo.k +0 for k = 1,...,m. (5.10) 
kai 
If 
0<@ <i, Deng <1 and ® + © for k = 1,...,M 
o,k 1,k o,k 1,k (5.11) 
then (n,d ) is a WLRT for hypotheses 
E 
Ho: 6-6, and Har 6 = Ba, (5.12) 


P roo f. We have seen in Example 5.1 that under condition (5.11) 
+ 
variables Z, 8. 8. = 1m Ln 88," ner*, of WLRT (N,Ś) = (88. 


Aler? can be written as 
m 


n 
+ 
2.8.8,” > äi 7 Yor nef’, 
ov 1 fai kai 


where Yo Yo Ya are given by (5.6) and (5.7). Conversely, if 
real numbers To: (GC Yo and Yo,ır (CH: are given satisfying 
(5.10) then vectors 6, z (9, iesse rail and ©, = (9, 47...94 ei 
can be obtained so that 


Yo k = In ((1 9,0708 = 9,0) (5.13) 
and f 
1-0 
Yk = ln („1 —ak) (5.14) 


enki” 0, ,k 
fork = 1,...,m. Equations (5.13) and (5.14) are equivalent to (5.8) 
and (5.9). Hence, if (5.11) is true then (N,d) is a WLRT for (5.12) Œ 


Since the quantities TE. Aussen Y used in this lemma are not uni- 
0,1 mMm,1 a S 
quely determined a continuum of pairs 6 0,€@ will exist as a rule 
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so that test (N, 4) given by Yor hye nm] 18 a WLRT for (5.12). To 
characterize the situations where test (N, 6) given by (5.2), (5 
and (5.4) can be used for discrimination between two SES h e 
potheses we consider some gemetrical properties of the WALD appro- 
ximation of the power function M(8) of ON. bh ). Denote here this 
approximation by M"(8). If (N, 6) is a WLRT in the sense of Lemma 
5.1 we obtain (cf. (2.29)) 


_ 1 - exp(bh) —— if (0° Zu H o éi 
M"(6') m exp(ah) - exp(bh) IR dëi (9581): 
- b 


, if @' is an exceptional point, 


Lemma 5.2. Consider test (N,ó ) given by (5.2), (5.3) and (5,4), 
Suppose that there exist parameters 6 8.8 ©) so that Lemma 5.1 
holds. Denote by ®* the set 


e, {8€ ©: Pg(Z,< 0)> O and Pg(Z, 70) 70}. 
For every hE(-@,+%) let ON be defined by 
m e 
ER = {ő cQ“: T ] (coxpchy,) - KI + 1) = exp(hy,)}if h+0 


and 


m 
Op -{6eo": D Të ës 0} ifh=0. 
k=1 
Then we have 
~ a 
_1- exp(bh) For Be, h O, 
m*(ö) S exp(ah) - exp(bh) ` , (5.15) 
a for 6€Q. 
a-b 


Pr oo f. According to Lemma 3.1 test (N, ó) can be regarded as a 
WLRT for Ho :6 = 2. against H." 8 = 54. Consider the WALD e 
gg M (8) for the power function AH Ge, of (N, ó js I 

Ch Eh E (6, .6,) then we obtain 


ZEN = (1 - exp(bh))/(exp(ah) - exp(bh)) (5.16) 


and (6',0") ~ (6, ,8,) partia 


ua] (È um" 
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or 
m N m 
x 1-X 
„ık R 1k X, 1-X 
| (e; (1 - er) )- exp(hZ, ) | IEN Ikea - op) ei 
k=1 k=1 


where zZ, is given by (5.2), (5.10), (5.13) and (5.14) forn=1. 


Hence, we obtain 


X 1-X 
m 9 1k 1-9 ik. h 
1,k (AN 
E | | 4K E S 8 
d, (( } ( ) ) Eg.exp(hZ ) 
k=1 No ,k 1 "Bak i 
Eg exp(h 08% 1k ` d 


k=1 


m 
esst Ap) | [((exp(my,) - De; + 2) 
k=1 
= 1. 


Otherwise, since Ez.exp(hZ,) = 1 for Seo", with h # O the term 
-X 


exp(hZ,) 1 (e 7 Sri - 9: TE i 


can be regarded as a ne es Tunetion of Ra for a parameter EN 
that satisfies (6° Eh »& (6, ‚8 al, This implies (5.16) for 8" eo", 
with h # O. Next, it is a ei Rasa fact, see e.g. GHOSH [35], 
Lemma 3.4, that for b'e On equation Eg. exp(hz, ) = 1 has only so- 
lution h = O if Eg.2, = O. That means, that in case Che = 0 
there does not exist a parameter CAO) with (8 ja" jeb (8, A=) 4) so 
that Gr is an exceptional point. Hence, we obtain 


M*(6') = - b/(a - b) for Eg: Zi = O and o ep, 


This completes the proof. W 


By this lemma the hypersurfaces are characterized on which M*(8) 
is constant. These hypersurfaces are given by the equations 


m 
| |ccexpchy, ) - 1)0, + 1) = exp(hy,) for ho (5.17) 


k=1 
and 
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m 
DER, -¥, 7 0 for haO, 
k=1 


respectively. 


We discuss some properties of these hypersurfaces. 
(i) Let h O. Then we can write (5.17) as 


m m 
-1 
(e, - lw exp(hy,) (| [(exp(ny,) - 0) . 
ln ` sep "zefill = 2) 


This equation is for the particular case m = 2 the algebraic equa- 
tion of a hyperbola with asymptotes 
H, =- i/(exp(hy,) - 1) for k = 1,2, 
see also MALY [56]. 
(ii) If we may suppose that Bee KS for i,j = 1,...,‚m then we have 


m 
exp(-hy,)| [(Cexp(hy,) - 298, + 2) 
k=1 


n i 
oS exp(-hy,)( > ((exp(hy,) - 1)0,) + 1), 


k=1 
Thus, we may approximate the hypersurface (5.17) for sufficient 
small values of O,4+++8, by a hyperplane with algebraic equation 


. 


m 
> (exp(hy,) - 1)0,/(exp(hy,) - 1) = 1. 
k=1 


This may be of interest in certain quality control problems. 
(iii) We may consider relation (5.17) as an implicitly given func- 


tion with dependent variable 9. k A EI o? Then, by (5.17) we 
have 


m 
E = vr (a/f Tone) = 1)0, + 1) - d 


jtk 
If ¥,70 for k = 1,...,m one may show that these functions are 
convex for h>O and concave for h<O, respectively. 


We now consider some monotonicity properties of Mm*(8). In case of 
= # 
m = 1 we know that M (0) is strictly monotonical in @ on@. For an 
appropriate assertion in the m-dimensional case, my 1, we have to 
define in which sense we want to compare several parameters of ©, 
We shall sa ar H Oo e 
y parameter Or is better than parameter gr: et 


160 


(write: o< 8") LTT H £ Hu for k = 1,...,m and there at least exists 


one K"€41, vg sët with Bu < Ore: 


Le mm a 5.3. Suppose that Lemma 5.2 holds. If Zu zU for k = 


1,...,m then we have 


> = > A 
m*(ő' j< m"(0") for 6< ë, bbe ©. (5.18) 


p roo f. Without any loss of generality we may suppose that ©' and 
6" differ only in one component, say Ba" Ope To given @ €@ we con- 


sider function = 
5 e -h | | hy.) = 298, + 1 
path) = Egexp(hZ,) = exp(-hy,) E gi Ké 


as a function of h, -co<h<+00, which is convex from below with 
lim Weih) = eo for 6C@ (see e.g. [35] , Proof of Lemma 3.4). 
+00 


Zén by h(6) for Sep the uniquely determined non-zero solution 
of Palh) = 1 if Eai, A O. Let h(8) be zero if Egz, = O (we refer 
again to [35] , Lemma 3.4) then the following cases may arise: 

(1) Eg.Z,< O: Then we have h(@) > O and (5.19) implies exp (hy, ) - 1 
20 for h>O and Yk? 0, k = 1,...,m. The convexity of Y3.(h) im- 
plies 


m 
1 = g.(h(8")) = exp(-h(8")yx) | ]((exp(h(S")¥,) - De, + 1) 
k=1 


m 
< exp(-r(8")y,) | [erore - mei + 4) 
k=1 


= Pa.(h(8')). 


Hence, we obtain h(8')> h(6"). 
(ii) Eg.2, = O: Then we have h(8') = O and by fp? O for k = 1,...,Mm 
and aka < Ole we obtain 


ZS e 5 d Ti " Yo SEN -7 Yo Fan: 
= k=1 


For Eg„Z,> O we obtain h(0") <0. This implies h(6')> h(6"). 
(iii) Eg.Z,> O: Then we have h(9')<O and (5.19), exp(hy, ) - 1<O 


for h<O and k7 O for k = 1,...,m and the convexity of Ga, (h) 
imply e ° 
1= Pg.(H(8"))< pa.(hie')). 


This provides again h(8')> h(6"). 
Hence we obtain 
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h(6')> hië rer < än, Bore Or. (5.20) 


NOW, if Wë ) + O we have (0',0") dÉ) (8, , 1) for 6'e ©” where 
H. and ER are determined like in Lemma 5.1. hu, we obtain 


M"(6") = (1 - exp(bh(d'))/(explah(d') - exp(bh(d")). (5.21) 
If h(6') = O then Ö' is an exceptional point and we obtain 

M*(8') = - b/(a - b). (5.22) 
Hence, by (5.21) and (5.22) we obtain 

M*(6')<M*(6") for h(6')> h(O"). 


This, together with (5.20), provides (2.18). W 


The monotonicity properties of MII) can be used to obtain a corres- 
ponding admissibility assertion for composite hypotheses. 


Lemma 5.4. We suppose that Lemma 5.2 holds where $k 70 for 

k = 1,...,m. Let CH and ©, be disjoint subsets of ©”, we suppose 
that finite Deet ee of Dä exist so that 

(i) for every Sep, there exists a 6'€@®' with 9<®"', 

(ii) for every Sei, there exists a HAO) “with 0"< 8, 

(iii) Egz,<O for eg 

(iv) EgZ,>70 for GE)". 

Then, by a choice of sufficiently large stopping bounds lb] and a, 


we may reach 
*,2 E 
M"(Q)<¢ oe for g eo, (5.23) 


M"(6)21- 8 for gen, | (5.24) 
to given GB, O<xX,B<1, X + B<1. 


and 


Proof. For every 860, there exists a B'E@' with 6<0'. By 
Lemma 5.3 we obtain M“(8)< m*(6'). Since ‘ek is a finite set this 
implies 

m*(3) < max Miri for gei, (5.25) 

o'e ©’ j 

Denote by h(6) the non- zero solution of Geib) = Egexp(hZ, ) = 1 for 
Bar £ O, sea”. Then, for o'e Or we have Eq. z,<o and therefore 
h(a" )70. Since Gär is finite this provides 

min h(6') = h(6*)>0, 6*E@’, 

9'Ee &' 
and, together with (5.25), we obtain 


M*(8)s M"(6") = (1-exp(bh(8*) )/(exp( ah(S*) -exp(bh(S*)) , eech 
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Analogously, we may obtain a Ste" so that h(6"") <0 and 
Mm*(8) 2 m*(8**) 


= (1 - exp(bh(8**))/(exp(ah(d**) - exp(bh(8"*)), BEQ, 


5.27 
This, together with (5.26), provides (5.23) and (5.24) for ( 


sufficiently large values of |b| and a. W 


we notice that the conditions (i) to (iv) of this lemma are fulfil- 
led, for instance, if sets ©, and D. can be strongly separated 


by hyperplane Eaz, = O. 
we consider a special case. Let OR and Ch be given by 


m 
F e 
@, = (ee O: > ZE 1} (5.28) 
ans kai °k 
= = H, 
O, sigep: 2 m? 1) (5.29) 
=1 k 


where el“) and el P) denote given real numbers, o<ol“). el Di. 

for k = 1,...,m. Our aim is to discriminate between hypotheses 
H. Ge OA against H,: Se ©,- (5.30) 

Problems of this type may arise in quality control if we consider 
a lot of items where the quality of each item is characterized by 
m several attributive and stochastically independent quality charac- 
teristics. Then, the quantity al) may be regarded as the ‘conditio- 
nal‘ acceptable quality level to the Kt quality characteristic if 
defects may only occur at this quality characteristic. In an analo- 
gous manner we may regard o(®) as ‘conditional’ limiting quality. 
The following lemma presents a condition for the choice of quanti- 
ties Yo: Yo Yn of test variable Z, of test (N,d) given by 
(5.2), (5.3) and (5.4). 
Lemma 5.5. Let ©, and 9, are defined by (5.28) and (5.29). 
Suppose that 


Yk? ¥o?9 for k = 1,...,m (5.31) 
and 
of) We of®) for k = ien ef, (5.32) 


k 


Then we have 
M"(6')< Hië) for 6'< 6" and dr. gre Oy 


Moreover, for sufficiently large values of D and a we may reach 
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M*(0) e oi for 98€ Gap (5.33) 
and + 
m*(6)> 1-8 for dEeQ,N® (5.34) 


to given X,ß, OCX, Bei, K+ B<1. 


Proof. Since ¥, 70 for k = 1,....m the monotonicity of M"(@) 
is an immediate conclusion of Lemma 5.3. Consider the hyperplane 
EgZ, = O. This hyperplane intersects the 0 -axis at H, = Ta for 
k = 1,...,m, and under condition (5.32) this hyperplane strongly 
separates sets ©. and OPE Applying Lemma 5.4 we obtain (5,33) 
and (5.34). WB 


According to (5.31) and (5.32) the range for the choice of the quan- 
tities rt, Yieee Ze is very wide and, by a proper choice of these 
quantities, we may take influence on the average sample size of our 
test. Without to discuss this problem in the details a suitable 
choice seems to be the following if ol“) and el fl are sufficiently 


small for k = 1,...,M. 
Let a(x) and (8) are for k = 1,...,m real numbers 80 that to given 


ol“) and ef, oe ell, ei PI, 1, 
DEINEN, Kennen 


and 


tie 1 - 8%) 
i= aB) 1- aB) l 


If we choose a 
A e A 

y In ((1 - Bien - Gin 
and 
fk =" To + In GM) for ku 1,.0.,M 
then assumptions (5.31) and (5.32) of Lemma 5.5 are fulfilled and 
test (N, 6) is admissible in the sense of Lemma 5.5. 

* 

We remark that in case of 84® we have either 


+ “A -> 
SEO- {6€@: Pg(Z,> 0) = O and P,(Z,< 0)? 0} 


~ ÊA + , 
OEH = {060 : Pg(Z,>0) 70 and P,(Z,<0) = o}. 


X are 


The case Pa(Z, = O) = 1 is impossible since the ËU dm 


assumed to be independent. Evidently, we obtain 
8 ~ EN + á A 
M(6) =0 for goë and MS) = 1 for GE. 


Under the conditions of Lemma 5.5 we furthermore obtain 
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n m 
Pa(Z, > 0) = Pa ECH = d ss 1 -= Ta = 8); 


k=1, 
e m 
e 0) = rel cht ‘ di À I Tes ea)» 
Hence we obtain 


Ö-{de®: Ti, - 8.) =1}=(ö}, 


k=1 


m 
A > 
@ = {8€@: | fe - @) = of. 
k=1 
That means that set ©" contains at least all interior points of IG, 
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ALGEBRAIC AND DIFFERENTIAL TOPOLOGY - GLOBAL DIFFERENTIAL GEOMETRY 
Edited by George M. Rassias 

This Teubner-Text contains a series of specially invited research 
and expository papers written by eminent scientists from the = 
national community on the occasion of the 90th anniversary of SP: 
Marston Morse's birth. 

This commemorative volume provides an insight and analysis on var; 
research problems and recent new theories in the fastest deln 
and very interesting fields of Algebraic and Differential Topologn 
Global Differential Geometry and Related Topics such as the idea’ 
Analysis of Differential Equations (Ordinary and Partial) and of | 
Calculus of Variations. - the 
Bd. 70, 348 Seiten, 1984, M 36,-- 


H. HECKENDORFF 

Grundlagen der sequentiellen Statistik 

In diesem Text wird ein systematischer Zugang zur Darstellung der 
Grundlagen der Theorie des sequentiellen statistischen Experiments 
erarbeitet. Dieser Zugang beinhaltet die für die Anwendung stets ` 
gleichermaßen bedeutsamen Aspekte der Festlegung der Strategie der 
Versuchsplanung, des Umfangs des Experiments sowie der auf den ent- 
stehenden Stichprobenräumen basierenden Entscheidungsregeln. Dabei 
wird der gerade im sequentiellen Fall besonders relevanten Nutzung 
des Prinzips der Suffizienz besondere Aufmerksamkeit gewidmet. Ferner 
wird die sequentielle Bayessche Entscheidungstheorie in gewisser 
Gründlichkeit eingeordnet. Die Theorie der sequentiellen Versuchspia- 
nung wird für die Aufgabe des zweiarmigen Banditen und für das Re- 
gressionsproblem spezifiziert. | 

Bd. 45, 166 Seiten, 1982, M 18,-- 


V. G. KORNEEV/U. LANGER 


Approximate Solution of Plastic Flow Theory Problems 


The book is devoted to several aspects of the numerical solution of 
boundary value problems in the flow theory of plasticity and may be 
used as a text-book for university students and postgraduates 
specializing in numerical analysis and mechanics. The main boundary 
value problems, including problems which are illposed, and various 
methods of regularizing them, are considered together with some 
preliminary results obtained from the investigation of solvability 
in Sobolev spaces. The numerical schemes considered are based on the 
finite element method, the incremental loading method and some 
iterative methods for the solution of plastic flow theory problems 
and the systems of nonlinear algebraic equations arising in the 
process of their numerical solution. 

Bd. 69, 252 Seiten, 1984, N. 26,-- 


S. L. KRUSCHKAL/R. KÜHNAU 


Quasikonforme Abbildungen - neue Methoden und Anwendungen 


Es werden einige neuere Methoden und Entwicklungen, Ergebniss» tte 
Anwendungen der Theorie der quasikonformen Abbildungen datge siS 2 
Zur Behandlung kommen Extremal- und Wertannahmeprobleme bei "Ger ir 
hängiger Dilatationsbeschränkung, u. a. auch mit der Methode Sir Ex- 
holomorph invarianten Metriken, allgemeine Darstellungssät?6 Aen 
tremalfunktionen, einfache asymptotische Abschätzungen. Es ve Elektro" 
Anwendungen auf Extremalprobleme gegeben, z. B. in der oo ee ichmil ler 
Statik bei inhomogenen Medien. Der Zusammenhang zwischen Formen Sch 
schen Räumen und schlichten Funktionen mit einer quasikonto 

setzung wird ebenfalls beleuchtet. 

Bd. 54, 172 Seiten, 1983, M 17,50 
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B. LISEK/J. HOCHSCHILD 
Sequentielle Zuverlässigkeitsprüfung 


Die statistische Zuverlässigkeitsprüfung ist ein Gebiet mit großer 
praktischer Bedeutung. Für den Fall exponentialverteilten Ausfallab- 
stands werden alle damit zusammenhängenden Fragen ausführlich disku- 
tiert, wobei sequentielle Prüfungen im Mittelpunkt stehen. Neue Er- 
gebnisse betreffen die Möglichkeit extrem kurzer Stutzung sequentiel- 
ler Prüfungen. Größter Wert wird auf Modelldiskussionen und Interpre- 
tationen gelegt. So ist die Darstellung auch für Nichtmathematiker 
verständlich. Es ist eine große Zahl von Tabellen aufgenommen worden 
die für den Zuverlässigkeitspraktiker nützlich sein werden. 
Bd. 53, 152 Seiten, 1985, M 16,-- 


W. NATHER 
Effective Observation of Random Fields 


The book deals with designing methods for linear estimation of the 
trend and for linear prediction of random processes and fields with 
known covariance function. Especially, effective observation methods 
for the least-squares estimator and the best linear predictor are 
considered (chapters 4-8). In these chapters the main goal consists 
in demonstrating to what an extent classical convex designing methods 
(chapter 3) can be modified to yield useful results in the process 
case. Besides exact, iterative and asymptotic. procedures also appro- 
Ximative methods are proposed. The remaining part is devoted to the 
problems of the optimal choice of an observation region, of weakening 
the assumption of a known covariance function and deals with designing 
methods using Fisher information (chapters 9-11). 

Bd. 72, 184 Seiten, 1985, M 18,-- 


L. PARTZSCH 
Vorlesungen zum eindimensionalen Wienerschen Prozeß 


Das vorliegende Buch entstand aus einer einführenden Vorlesung über 
den eindimensionalen Wienerschen Prozeß. Sein Hauptanliegen ist eine 
ausführliche Darstellung der klassischen Grundlagen: Konstruktiver 
Existenzbeweis, Invarianzeigenschaften des Wienerschen Maßes, Bestim- 
mung der Verteilung ausgewählter Funktionale, lokale und globale 
Eigenschaften der Realisierungen. Anschließend werden zwei speziel- 
lere Probleme behandelt, nämlich die Skorochod-Darstellung und das 
Strassensche Gesetz des iterierten Logarithmus (hierbei spielen eine 
Cameron-Martin-Formel und Exponentialabschätzungen für das Wienersche 
Maß eine wesentliche Rolle). Vom Leser werden nur einfache Kenntnisse 
über stochastische Prozesse vorausgesetzt. 

Bd. 66, 112 Seiten, 1984, M 12,-- 


ds PILZ 


Bayesian Estimation and Experimental Design in Linear Regression 
Models 


The book deals with estimation and experimental design for linear 
regression models in the presence of prior knowledge about the model 
parameters; the approach is Bayesian throughout. The first part 
starts with a formulation of the compound problem of estimation and 
design within the framework of Bayesian decision theory, and then 
proceeds with the specification of a prior probability distribution 
for the model parameters. The second part is concerned with the na- 
tural-conjugate Bayes estimator under normally, independently and 
identically distributed errors and quadratic loss, and studies the 
robustness of optimality under a change of the model assumptions, 
furthermore, some relations with other important alternative to the 
least squares estimator are established. The third part is devoted 
to the experimental design problem for the Bayes estimator and deals 
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‚eXtensivly with the construction of both optimal approximate and 


Optimal exact designs. 
Bd. 55, 216 Seiten, 1983, M 20,-- 


P RECENT TRENDS IN MATHEMATICS, REINHARDSBRUNN 1982 
Editors: H...Kurke J. Mecke/H. Triebel/R. Thiele 


The conference "Recent Trends in Mathematics" was held at Reinhards- 
brunn, GDR, from October 11 to October 13, 1982. It was organized p 
the BSB B.°G. Teubner Verlagsgesellschaft, Leipzig, and was attended 
by mathematicians from Austria, Canada, Czechoslovakia, Finland 
France, FRG, Great Britain, Italy, Japan, Poland, Poumania, Sweden 
U.S.A., USSR, and GDR. This fiftieth Teubner-Text contains 3] lectu- 
res given at this conference. 

Bd. 50, 336 Seiten, 1983, M 30,-- 


H.-U. SCHWARZ 


Banach Lattices and Operators 


The book contains an introduction to the theory of vector lattices 
Banach lattices, and bounded operators in Banach lattices. The theory 
of vector lattices is developed as far as it is needed for further 
investigation of Banach lattices. In the second part, which is con- 
cerned with Banach lattices, the main emphasis lies on the presenta- 
tion of various classes of Banach lattices, as order complete spaces 
KB-spaces, and others. All lattice theoretic notions are discussed 
in Classical Banach spaces and in Köthe function spaces. The third 
part deals with basic order properties of linear operators, and some 
special classes of operators. The results are used to study the 
Structure of Banach lattices. . 

Bd. 71, 208 Seiten, 1984, M 19,50 


STOCHASTIC GEOMETRY, GEOMETRIC STATISTICS, STEREOLOGY 
Editors: R. Ambartzumian/W. Wei 


This volume contains contributions to the conference "Stochastic Geo- 
metry, Geometric Statistics, Stereology" in Oberwolfach, 1983, as 
well as a number of further papers in this field. The topics cover 
various parts of Stochastic Geometry: random sets, integral geometry, 
point processes, statistical geometry, random coverings, random 


mosaics, stereology. 
Bd. 65, 268 Seiten, 1984, M 27,50 


F. TROLTZSCH . . 
Optimality Conditions for Parabolic Control Problems and Applications 


This text is concerned mainly with necessary optimality conditions 
for optimal control problems governed by non-linear parabolic diffe- 
rential equations, where the control may occur on the boundary or 
within the domain under consideration. Thereby constraints on the 5 
state as well as on the control may be given. The theory 1s Rh 


j j trols. 
up to the proof of bang-bang properties for optimal con Cie cos 
lems are treated by converting them into a control proble 
problems y g 5 space and by applying 


Hammerstein integral equation in a Banac There- 
ipli ract mathematical programs. _ 
Lagrange multiplier rules for abst he optimal control of Ham 


fore, the teyt also contains a chapter on the -Tucker 
merstein integral equations and an introduction to Ee Banach 
theory for non-linear mathematical programming proble 


spaces. 
Bd. 62, 164 Seiten, 1984, M 17,-- 


Diese Reihe wurde geschaffen, um eine schnellere Verö 
mathematischer Forschungsergebnisse und eine weitere 
mathematischen Spezialvorlesungen zu erreichen. TEUB 
in deutsch, englisch, russisch oder französisch ersc 
alität der Reihe zu erhalten, werden die TEURNER-TE' 
druck hergestellt, da so die geringeren drucktechnis. 
eine raschere Herstellung ermöglichen. Autoren von TE 
liefern an den Verlag ein reproduktionsfähiges Manusk 
Auskünfte darüber erhalten die Autoren vom Verlag. 


This series has been initiated with a view to auicker publication of 
the results of mathematical research-work and & widespread circula- 
tion of special lectures on mathematics. TEUBNER-TEXTE will be pu- 
blished in German, English, Russian or French. In order to keep this 
series constantly up to date and to assure a quick distribution, the 
copies of these texts are produced by a photographic process (small- 
offset printing) because its technical simplicity is ideally suited 
to this type of publication. Authors supply the publishers with a 
manuscript ready for reproduction in accordance with the latter's 


instructions. 


Cette serie des textes a ete crebe pour obtenir une publication plus 
rapide de résultats de recherches mathematiques et de conférences 

sur des problémes mathematiques speciaux. Les TEUBNER-TEXTE seront 
publiés en langues allemande, anglaise, russe ou française. L'actuali- 
te des TEUBNER-TEXTE est assure par un procede photographique (im- 
pression offset). Les auteurs des TEUBNER-TEXTE sont priés de four- 
edition un manuscrit prét a @tre reproduit. Des 


nir a notre maison d'é : 
renseignements plus precis sur la forme du manuscrit leur sont donnés 


par notre maison. 


Ara cepun una co3qgaHa ann OGecneyeHHA 6onee G6eCTporo NYÓNWKOBAHHA f 
Pe3yNLTATOB MaTeMAaTHYeCHHX HCCNeQOBAHHH H 6Öonee wHpOoKOrO pacnpocTpa 
HEHHA MATEMATHYECHHX ACKUHH Ha CngUHnRätHHE "enn, Manannn Copnn 
TONGHEP-TEHCTE GyayT NyYÓNHKHOBATbCA Ha HEMEUHOM, AHF IHnCH OP, En 
Hin BPaHuUyCKOM AsbIKax. ANA oëecngugunn AaKTYyaNbHOCTH nu, 
HHA ÖyAYyT HSrOTOBNATBCA POoTOMmexaHnn4eckom cnoco6om. Takum rola ee 
Gonee CHPOMHLIE TpeGoBsaHHA HK NONHFpahnuecHOoMy ooo oe in TOPBHEP-TEKCTE 
onee 6LIcCTpoe NOABNEHHE B CBET. Apropn H3MQaHHA CepHH Tpe6osa- 


AL HS 
OyAyT NpegocTaBNATbL H3AaTenLCTBy PYHONHCH, Be Aer 
HHAM BOTOMeEXaHH4ecKoro neYaTaHHA. bonee MoAPOÖHLIE 


nony4yaT OT WM3A3TEeNnbLCTBA. 


BSB B. G. Teubner Verlagsgesellschaft, LeipziB 
DDR-701 Leipzig, Postfach 930 
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